Video

Thanks for letting me know! Yeah, probably not the last time either of us will be infuriated by Pro, but it's great when it works!

Thank you for the kind words! I appreciate it.

No, I'm afraid not! Never used that one.

do you mean PennState model?

@@unmaroolable Yesss.. please

Cool, and thanks for letting me know!

Good idea, and thanks for the suggestion! I'll try to remember that for the future. It's kind of fun thinking that people around the globe are trying it out!

Oh, sorry. Does the comment below apply to this too?

Hey, my apologies for taking so long to respond! Yes, hopefully the comment below explains how to do it. So far ArcGIS Pro doesn't have any tools to do this directly, so you'll either need to write code to do it manually or try the workaround described below. Hope this helps! Take care - Jeff

@@jennessenterprisesadventur5081 Thank you! I know that's maybe too much to ask, but did you ever written a code, so I can take a look at this. I do not find a lot of information on this somewhere else. If not, I will give it a try with Excel.

Again, my apologies for the delay! I actually have written code for this, and I use it all the time, but it's in VBA for ArcMap, and uses ArcObjects. ArcGIS Pro doesn't use ArcObjects at all, so the VBA code would be very hard to translate to anything ArcGIS Pro uses. One of these days I plan to do it in C#, but I'm having trouble getting anything to work in the ArcGIS Pro SDK in Visual Studio. I'd have no idea how to do it in Python. If you have access to ArcMap, and have a VBA license, I'd be happy to send you an MXD with the code in it. Let me know; you can reach me at jeffj@jennessent.com. Take care - Jeff

Possibly. What did you have in mind?

Hi Steavi, That's a good question. It's difficult since every cell has a different flow accumulation value. I can think of two possibilities, both assuming you've already created your polylines (see Lab 7; czcams.com/video/LPGMt3y5fQQ/video.html): 1) Do you really need every flow accumulation value along the stream segment recorded? If you only need the maximum value along the segment, then you can use the "Zonal Statistics as Table" tool to generate a table of Flow Accumulation statistics for each segment, then join that table to you your stream segments feature class. Then you'd have maximum, minimum, etc. flow accumulation for every segment. 2) If you do need a separate segment for each unique flow accumulation value, the you could convert your Flow Accumulation raster to a polygon feature class (which will likely produce a very large feature class), then intersect your stream segments with those polygons. This will clip every segment to the flow accumulation cell boundaries and attach that flow accumulation value to the clipped segment. Hope this helps Steavi! Take care - Jeff

@@jennessenterprisesadventur5081 Thank you so much! I watched Lab 7, it gave me exactly what I needed. I also tried the Raster to Polygon as an alternative and it also was exactly what I was looking for, and the intersect worked out perfectly for me. thank you so much!

@@steaviswinson7895 Cool, and thanks for letting me know! I'm glad I could help. Take care - Jeff

Yeah, and Esri keeps changing the menus with each new version. It's a challenge!

Certainly Rajat. I believe these videos calculated density in units of Points per Square Kilometer.

@@jennessenterprisesadventur5081 as do I, but there is a difference between believing and knowing, So do you believe or know?

At this point I only believe. To know I'd have to go find the rasters I generated in that lab exercise and look at the metadata, and that would take some time. The parameters I used would be recorded in the geoprocessing history. I suspect that you really care more about the units of your own analysis than my example in this video, so remember that you choose the output units you want when you run the tool. So there really is no mystery about the output, other than the general complexity of kernel density analysis itself. Of course, it is easy to forget what units you chose after you've run the tool (as well as the bandwidth you chose, or any other parameter). This is definitely a common problem. Fortunately all that information is stored in the kernel density raster metadata. Regarding the metadata: ArcGIS Pro stores a great history of all geoprocessing operations that have been applied to a dataset, in a section called "Geoprocessing History". However, by default ArcGIS Pro only shows you a small subset of all the metadata available on that dataset, and that subset does not include the geoprocessing history. You need to change your metadata style to anything other than "Item Description" in order to see the geoprocessing history (see roughly 5:50 in the video czcams.com/video/4IVuyEqtOeA/video.html for a demonstration on how to change your metadata style). I hope this helps Rajat! Take care - Jeff

@@jennessenterprisesadventur5081 surely did help. Thank you Jeff.

I'm glad it helped! Thanks for letting me know.

Thanks Sean! I'm glad it was useful, and I appreciate the kind words. Regarding the owls, it's been a while but I'm pretty sure I went into the feature class in code and just subtracted a constant value from each X- and Y-coordinate. I wanted to put the two owls side-by-side (in map space), so I made sure that my subtraction value put them in that space relative to each other. I also clipped out the background imagery and topo maps and shifted them by the same amount. I had to do some editing on the topo map to remove identifying labels (road numbers, topographic names, etc.) I think you could do this easier than I did, though, by opening up an edit session and just selecting the owl locations, then dragging the entire set to some new location. It might be tricky getting the imagery to shift by exactly the same amount, but not impossible. And of course I did all this on a copy of the data; I still have the original locations, since that was my own research. Does this answer it? Please let me know! Take care - Jeff

@@jennessenterprisesadventur5081 Awesome! Thanks for the quick and thoughtful reply! I ended up using the 'Shift' tool which essentially uses your method to move my rasters based on X and Y coordinates. Thanks again!

Thanks for the kind words Abdulrhman! This was a good start to the day!

I'm glad it helped, and thanks for letting me know!

Certainly Ghassan! I have links to all the class data, lab documents, powerpoints and videos in this Word document: docs.google.com/document/d/1bPZq91EhDASOhkumcM-v1UDVCiVm5RyH/edit?usp=drive_link&ouid=113601434494391531497&rtpof=true&sd=true Thanks for the kind words, and I hope the lab exercises are useful! Take care - Jeff

i need the data and sattelite image for this video

Can you tell me more about which datasets you need? The satellite imagery is just the standard Esri background imagery, although I occasionally use USDA NAIP imagery. The NAIP imagery is only within the United States, though. Do you need those rectangles and hexagons I used to demonstrate the vector geoprocessing tools? I'm happy to share, but I'm not sure offhand where they are. I can find them for you if it's important, though. Let me know.

@@jennessenterprisesadventur5081 yes please i need those rectangles and hexagons used in demonstrating the vector geoprocessing tools and also if you have sattelite image i could use for additional practise i will be thanksful if you can send it. Thanks in advanced

@@jennessenterprisesadventur5081 May i know if these materials will be sent to me on my email ?

Thanks for the kind words! I'm glad they've been useful. By "rescale", do you mean to convert the density surface values into units that are easier to compare between different analyses, such as cumulative volume under the curve? In this case, you could identify the region in which that object you are studying spends, say the top 50% or 90% of its time. That's the strategy I usually take when I want to compare different animal home ranges. If so, then so far ArcGIS doesn't offer any tools to do that (at least as of today, in April 2024). I've written my own code to do it, but it only works in ArcMap. I think AdeHabitat (in R) can do this. However, if you are patient and willing to spend a little time, you can get a very close approximation of the true volumes under the curve doing a few steps in ArcGIS Pro and Excel. I outline the steps in this document: docs.google.com/document/d/12W_8TYul1P35h17mZNc7HYBsg2Irk5dm/edit?usp=drive_link&ouid=113601434494391531497&rtpof=true&sd=true Please let me know if this answers it for you, or if I am misunderstanding your question. Thanks again for the kind words! That is always a good way to start the day. Jeff

Thank you so much Mariola! Your comment lightened my day!

أتمنى لو أستطيع! لكنني أظن أنه يمكنك القيام بعمل أفضل مما أستطيع فعله لمجرد أنك تعرف مزرعتك. ليس لدي أي طريقة للتنبؤ بالمكان الأفضل لحفر البئر، لأن ذلك يتطلب معرفة طبقة المياه الجوفية الأساسية. إذا كان لدينا نموذج تفصيلي للارتفاع، فيمكننا أن نوضح أين ستتدفق المياه على السطح، ولكن مرة أخرى أظن أنك ربما تستطيع رؤية ذلك بنفسك من خلال تواجدك هناك. أنا آسف لأنني لا أستطيع تقديم المزيد من المساعدة! لكنني لا أعرف ما الذي يمكنني فعله، ولا يمكنك القيام به بشكل أفضل.

@@jennessenterprisesadventur5081 هل تسطيع عمل تحليل هيدرولوجي للمنطقة التي اعيش فيها

Sorry it didn't work for you! Fortunately there are lots of people out there trying to explain this stuff, so hopefully you'll find someone else who suits your learning syle better.

Hmm. Good question. I should probably add that info to future videos, shouldn't I? This was probably done with ArcGIS Pro 3.1.0 or 3.1.1. Possibly 3.1.2. It wouldn't have been 3.0 or earlier. Hope this helps! Take care - Jeff

@@jennessenterprisesadventur5081 Thanks. Because I tried using your data and it works with my 3.0.1 version but not with data that I got from my colleague (which is below version 3.0)

Thanks so much Gabe! I appreciate you letting me know. Today is a better day now!

Thanks so much Giancarlo! I much appreciate the feedback.

Thanks Cissy! I much appreciate the feedback! For global DEMs, I've used the SRTM (Shuttle Radar Topography Mission) and ASTER (Advanced Spaceborne Thermal Emission Reflectometer) data (both of which you should be able to find at earthexplorer.usgs.gov/). I had some issues with the ASTER data, though, because it appeared to map canopy height instead of ground height. This wasn't a problem when I just wanted elevations of locations, but it made it difficult to get accurate slope, curvature and hydrological data. I've head good things about the JAXA ALOS (Japan Aerospace Exploration Agency [JAXA] Advanced Land Observing Satellite [ALOS]) data (see www.eorc.jaxa.jp/ALOS/en/dataset/aw3d_e.htm), but I've never tried it. I've also downloaded lots of data in the past from UN agencies like FAO, but I don't think I've downloaded any DEMs from them. I've also occasionally found data by looking up the local administrative websites (like county, state or municipality websites) and searching for GIS data. In general, though, it might be difficult to find data that aren't in geographic coordinates. If you just can't find any, and if the tools you use to process them don't offer geodesic options, then you will just have to project them. If you do, make sure you use bilinear interpolation when you project! It'll modify your topography a little, sort of like smoothing it with sandpaper, but probably won't do any critical damage. Hope this helps! Thanks again for the kind words. Take care - Jeff

Thanks so much Orlando! Your message was a good way to start the day. And what a place to be a biologist! One of these days I hope to see Brazil!

I'm glad I could help! Thank you for letting me know.

Thanks Joban! I appreciate the comments. You can download the Wildlife Lab data at drive.google.com/file/d/14EjFKmBLyIvO_x6w-SKHArvHeDYqRZlc/view?pli=1 (and there's also a link to it in the description below the video. If you like, you can view links to all my lectures and lab videos here: docs.google.com/document/d/1bPZq91EhDASOhkumcM-v1UDVCiVm5RyH/edit?usp=sharing&ouid=113601434494391531497&rtpof=true&sd=true ... and the full set of data for all the lab exercises is available here (and you'll need 7-Zip to uncompress it): drive.google.com/file/d/15-o52LTrJ-1Mk4ZLYoO3rCKcyotROLnA/view?usp=sharing Enjoy! Jeff

thanks for the reply! I just wanted to know how did you downloaded the lab data from? did you download it from USGS? was it converted to proper format? that's my question.@@jennessenterprisesadventur5081

basically what is the source of the data, any conversion between data format was done

For this example, the Canopy Cover came from an NAU Ecological Restoration Institute (eri.nau.edu/) dataset from many years ago; I doubt it is online anymore. The DEM came from the USGS National Elevation Dataset (see www.usgs.gov/3d-elevation-program), and I calculated the Slope directly from the DEM. The Coconino National Forest boundary came from the US Forest Service GIS Data Clearinghouse (see data.fs.usda.gov/geodata/). The environmental envelope threshold examples I use here are arbitrary; my goal is to show how to use the raster calculator to develop alternative envelopes more than it is to teach about Mexican spotted owl habitat use. Does this answer it? Please let me know!

thank you so much for the help! it helps a lot. @@jennessenterprisesadventur5081

Thanks so much Allan! I much appreciate the kind words.

Hi Nina, My apologies for taking so long to respond! I'm not quite sure why you are not getting many junction points. Are there visible places where streams connect, but no junction point is created? Or are there just very few stream segments? If the latter, then you might be able to get more streams by choosing a lower "stream accumulation" threshold when you're initially identifying stream locations. If that's not the solution, then I'd need to see what you're seeing. You can reach me at jeffj@jennessent.com. Hope this helps! Take care - Jeff

Glad I could help Bradley!

Thanks! I actually made the animations in ArcMap. For the watershed video I wrote an algorithm in ArcObjects that does what the Watershed tool does, growing the watershed cell-by-cell using the Flow Direction raster, and at each step I had it export a map. I symbolized the cells by how "old" they were in the process, shading from light blue to dark blue. I also had it zoom the map out a tiny bit at each step, and I had the background basemaps fade out as the scale changed, revealing another basemap underneath. At the end of the process I had about 1,000 maps exported, then I just treated each map as a single frame in a 30 fps video. I used Adobe Premiere Pro to combine the maps, and I think Adobe Bridge does this as well. For the demonstration of sinks, I used Camtasia to manipulate multiple images and graphics, having each appear and fade out over a short time period. Camtasia is actually pretty easy to use for this kind of animation. It makes video creation feel like playing a video game.

Thanks so much for the kind words! This was a good message to start the day with. I'm glad the videos are working for you and thank you for letting me know.

Thanks Kaitlyn! I'm sorry to say I do not. I did all this using custom ArcObjects code in ArcMap, and I haven't found equivalent tools in Pro yet that'll do it. Sorry I don't have any better answers!

Wow cool! I'm just thankful for the tutorials you do have. I'm working on a fish movement project (ironically on steams up in your neck of the woods) and they've been extremely helpful. Thanks!

That's good to hear Kaitlyn, and thanks for letting me know! This week is starting off on a good note now.

Hello J, My apologies for taking so long to respond! I am sorry to say I have not had this experience, so I am not sure what might be the problem! If you'd like me to take a look, please email me at jeffj@jennessent.com and we can try to figure it out.

Have you had any luck with this? My situation seem to be the same as yours, where during the stream order processing, it gets stuck at 8%.

Thank you so much, and my apologies for taking so long to respond! I am glad the videos are useful for you, and thank you for taking the time to let me know.

Update: I figured I could only add field using the geoprocessing too. PS: i'm using Arcgis pro 3.1 version! Hope this helps anyone who encounters this too.

Hi Mxzoe, Hmm. Could be a couple of things. Is there any chance anything in the geodatabase is currently in an "Edit" mode? Do you see any messages anywhere that say "Pending Edits"? If so, then that usually prevents you from adding an attribute field. I'm not used to that problem giving you a "Read-Only" message, though. Alternatively, try exporting your raster into a new file geodatabase. Maybe the current format is giving ArcGIS Pro grief, or maybe the current workspace has some issue with it. Putting it into a new file geodatabase might do the trick. And when all else fails, save your Pro project, close it, and reopen it. That might clear out whatever is causing the problem. Hope this helps! Take care - Jeff

My goal is to show the direction the effluent from WWTP is flowing too

I am so sorry to take so long to respond to you on this question! It slipped past me somehow, but I do apologize for my rudeness. If it is not too late to help, then yes, the stream polylines do accurately point downstream. The "StreamToFeature" tool requires the flow direction raster to run, and I suspect it uses this flow direction raster to correctly orient the stream polylines. You can symbolize the streams with arrows by adding an arrowhead-shaped marker symbol to the flowlines.

Yeah, I hear exactly what you are saying (and my apologies for taking so long to respond!). There is a solution (described in link below), but this is definitely a weakness of the ArcGIS density tools. So far they haven't offered a way to automatically convert the density values to anything describing the relative volume under the kernel density surface, so it is very difficult to choose a contour level that will describe the same activity level or usage for different animals. I've gotten around this in ArcMap by writing custom ArcObjects code to make true "Proportion Under Surface" rasters, from which it is easy to generate contours at any percentage-of-use level. You can get a good approximation of this without using any special code, though. It's a little tedious but you can do it with a combination of ArcGIS Pro and Excel. The basic strategy is to first identify the total volume under the curve, and then determine what density levels correspond with the percentile levels you are interested in. I've written up some instructions with illustrations here: docs.google.com/document/d/12W_8TYul1P35h17mZNc7HYBsg2Irk5dm/edit?usp=sharing&ouid=113601434494391531497&rtpof=true&sd=true Hope this helps! Take care - Jeff

Hmm, I'm not sure! I'm not familiar with that format. Can you tell me more about it?

Thanks so much for the kind words! Your message was a good way to start the day.

Hi Shahrul, Sure thing, and good question! There are actually a few options for the output units when you run the tool, but the most common way (at least in my experience) is as "Density" values. This means the value gives you an estimate of the number of locations per unit area within the neighborhood around each cell. If you're a wildlife biologist like me, and you go and map a bunch of spotted owl locations, then a cell value of "10" might be interpreted as "10 owls per square kilometer within the local region surrounding that cell". This can be a little confusing, though, because it's only loosely related to the actual number of locations on the landscape, and points are counted differently based on how close they are to the cell center. For example, a raster cell might have 5 spotted owl locations within your search radius (aka "bandwidth"), but the actual kernel density value will be higher if those 5 owls are close to the cell center than if they are far away. The "Kernel" is the algorithm we use to count points higher if they are closer to the cell center. Picture a three-dimensional bell-shaped curve positioned over the cell center. If an owl is close to the cell center, then the height of that bell-shaped curve at the owl's location will be high, and therefore that owl will contribute more to the final density value. Owls farther away will sit lower on the tails of the bell-shaped curve, and consequently contribute less to the final density value. ArcGIS only gives you one option for the kernel shape, and it looks a lot like the normal bell-shaped curve. One important difference is that the ArcGIS bell-shaped kernel drops off to zero at the bandwidth distance, while the normal curve never quite reaches zero. Other software packages like R let you choose different kernel shapes (for example, see www.researchgate.net/figure/Various-kernel-shapes-for-Kernel-Density-Estimation_fig2_283575639), which would change the overall kernel density surface a little. And at the end, the final density values are rescaled according to the area units you prefer. If you generate a density surface using Hectares as your area unit, and then generate another density surface on the same data using Square Kilometers as your area unit, then you'll find the density values in your first raster are all exactly 100x the values in the second raster because there are exactly 100 hectares in a square kilometer. If you really want to get into the weeds on this, take a look at B. W. Silverman's book "Density Estimation for Statistics and Data Analysis" (Silverman 1986). He discusses different kernel shapes you can use, and the Esri documentation on Kernel Densities mentions that they use Silverman's equation 4.5, on p. 76 of his manuscript. I hope this helps Shahrul! Take care - Jeff - - - - - - - - Silverman, B. W. 1986. Density estimation for statistics and data analysis. Volume 26. Monographs on Statistics and Applied Probability, CRC press.

Thanks so much! I'm glad it was helpful to you, and thank you for letting me know.

Yeah, I hear you! It's easy once you know how, but not immediately obvious. Thanks for the comment!

Thanks McKenna! Glad you liked it! And check out those LoCoH (Local Convex Hull) papers when you get a chance. It's a really clever implementation of Convex Hulls to narrow down the areas the animal cares about most.

@@jennessenterprisesadventur5081 Could I get to know which papers those are as well. and would you mind doing a video on using the Mahalanobis tool in Arc or qgis?

@@masababridget4960 Hello Bridget, I'm so sorry for missing this message! I do apologize for my rudeness in not responding. If it is still helpful, then you can download the LoCoH papers here: drive.google.com/file/d/186r5Rswi5SUI8AEC0Nz9bdZ7hD7ajlwj/view?usp=sharing And I'm afraid I'm not skilled in QGIS so I can't give a solid explanation in how to make it work. I really like Mahalanobis, but I'm going to hold off on a lecture until I've written a decent tool to do it. I've written those tools for ArcView 3 and ArcGIS Desktop (ArcMap), but I'm still fumbling through the ArcGIS Pro SDK.

Thank you for the kind words Anang! Much appreciated. There isn't really a single approprate threshold value, I'm sorry to say. It can depend on your DEM resolution and extent, because both of these affect the number of cells that contribute to the flow accumulation raster. And if you are trying to predict where actual perennial flow would occur, then that is also heavily dependent on local climate. I'd recommend looking at areas where the features you are interested in identifying are already classified (perennial streams, for example), and then checking what cell accumulation threshold would capture those areas. That would give you a good rule-of-thumb to use for your area, climate and DEM resolution. Hope this helps! Take care - Jeff

Thanks so much Mansour! Your message was a good way to start the week!

Thanks Felix! Hmm; that's an interesting question. As far as water chemistry goes, that's a tough one to pick apart. If your rivers are primarily spring-fed, then the chemistry is highly affected by the minerals present in the aquifers, plus how long the water is underground. You can get very different water chemistry measurements from springs that are right next to each other, if the aquifers producing those springs are not connected. So it can be tricky to predict water chemistry without a good understanding of the aquifers, and that kind of data is hard to get. Your question is a cool idea, though. We do a lot of water chemistry analysis of spring ecosystems at the Springs Stewardship Institute (springstewardshipinstitute.org/) so I have a lot of data I could work into a lesson. And my Forestry students would appreciate a decent lab exercise on the topic as well. Thanks for the idea!

@@jennessenterprisesadventur5081 Well said! Sourcing hydrochemical data is sure the major challenge but with several open national repositories, it is doable. Again dependent on the area of interest, perhaps one can use representative data to insight on such analysis. I will be looking out for that lab. Can't wait:)

Thanks so much for the kind words! Seeing your message was a good way to start the day.

Thanks! I much appreciate the kind words.

Hi Amy, My apologies! At this point I'm not charging for any of that, but thank you for asking. You can have it for free. I've been meaning to add download links to all these CZcams videos but just haven't got that done yet. In the meantime, you can view a document with links to download the data, lab exercises, powerpoints and ancillary stuff for all the learning modules at docs.google.com/document/d/1bPZq91EhDASOhkumcM-v1UDVCiVm5RyH/edit?usp=share_link&ouid=113601434494391531497&rtpof=true&sd=true. I plan to update that document periodically as I finish new modules, so please feel free to check it again in the future! Take care, and please let me know if you run into any problems with the data or lab exercises. Jeff

Thanks! I had fun making this one. Glad you liked it!