Code & Run

Community Empowerment Strategy Dashboard 2021 | WWF-Malaysia

Tool: Operations Dashboard ArcGIS, Survey123 for ArcGIS, ArcGIS Online Technique: XLSForm programming, web application development

The northern highland communities of Lun Bawang have been collaborating with WWF-Malaysia under the Sarawak Conservation Programme (SCP) to empower sustainable economies and managing their natural biodiversity through the Community Empowerment Strategy (formerly known as Community Engagement and Education Strategy).

Since 2016, the communities have been actively mapping out their land uses and culturally important locations to delineate their areas of settlement and source of livelihood. Given the close vicinity of their communities to the licensed timber concessions, producing a definitive map is important to preserve and conserve their surrounding natural capitals.

Several outreach has been done and the community mapping effort has been shifted to implement citizen science via the Survey123 for ArcGIS mobile application which is apart of the ArcGIS ecosystem. This enables the local community to collect information despite the lack of network reception and the data can still be synchronized upon availability automatically or manually shared with the field officers.

📌 Availability: Retracted in 2021

There is a moment where base maps just couldn't or wouldn't cut it. And DEMs are not helping. The beautiful hillshade raster generated from the hillshade tool can't help it if the DEM isn't as crisp as you would want it to be. And to think that I've been hiding into hermitage to learn how to 'soften' and cook visual 'occlusion' to make maps look seamlessly smooth. Cartographers are the MUAs of the satellite image community. 

I have always loved monochromatic maps where the visual is clean, the colors not harsh and easy for me to read. There was not much gig lately at work where map-making is concerned. The last one was back in April for some of our new strategy plans. So, when my pal wanted me to just 'edit' some maps she wanted to use, I can't stop myself with just changing the base map. 

The result isn't as much as I'd like it to be but then, we are catering the population that actually uses this map. Inspired by the beautiful map produced by John M Nelson that he graciously presented at 2019 NACIS; An Absurdly Tall Hiking Map of the Appalachian Trail. What I found is absurd is how little views this presentation have. The simplicity of the map is personally spot-on for me. Similar to Daniel P. Huffman as he confessed in his NACIS 2018 talk; Mapping in Monochrome, I am in favor of monochromatic color scheme. I absolutely loathe chaotic map that looked like my niece's unicorn just barf the 70s color deco all across the screen. Maybe for practical purposes of differentiating values of an attribute is deemed justifiable but surely...we can do better than clashing orange, purple and green together, no? 

So...a request to change some labels turn into a full-on make over. There are some things that I realized while making this map using ArcGIS Pro that I believe any ArcGIS Pro noob should know:

Sizing your symbols in Symbology should ideally be done in the Layout view. Trust me. It'll save you alot of time. 

When making outlines of anything at all, consider using a tone or two lighter than the darkest of colors and make the line thinner than 1 pt. 

Halo do matter for your labels or any textual elements of your map.

Sometimes, making borders for your map is justifiable goose chase. You don't particularly need it. Especially if the map is something you are going to compact together with articles or to be apart of a book etc. 

Using blue all the way might have been something I preferred but they have the different zonations for the rivers, so that plan went out the window. 

And speaking of window...the window for improvement in this map is as big as US and Europe combined. 

The devil in the details

I have started to post some videos demonstrating some tools in ArcGIS Pro. Short ones and pretty quick ones which I strived for since I absolutely am frightened with the idea of irritating people with unnecessary voice-over. It has no garnered much response and it's cool with me. Although, the lack of traction does things to my insides, I go back to the real reason I am doing thing, which is to stash the tools that I managed to learn on my own by trials and errors and keep them somewhere I can refer back to it to remember how it works.

Creating maps involves a number of iterative processes made to suit the intended output. Although creating maps itself is a form of art; heavily reliant on target audience's knowledge and aesthetical preference, it is still an inherently democratic science. Thus, knowing the mainstream technology and tools in the industry to express your vision or message is given. So for those just starting out with using geographical information software (GIS) for your final year project or research, this videos are meant for you. The purpose is not to overwhelm you with too many information, or distract you with my narration, but to follow in real-time the process from the start up of the software to the running of tools that generates the information needed.

Knowing fully well that there is an endless variety of GIS software or tools out there, processes that you need to execute to make things happen may vary in name and functionalities. Forget the beef between ArcGIS and QGIS, of which one is the better tool; if it serves your needs, then use it. You're not obliged to pledge loyalty to software or brands although you are encouraged to maintain integrity in your beliefs when it comes to corporate versus open source tools in the industry. Both choices come with their advantages and disadvantages. Yours truly uses QGIS and ArcGIS Pro interchangeably. If it doesn't work in ArcGIS Pro, which I use primarily, I'll jump to using QGIS. It's not a big deal. If it works painlessly, there is no reason to feel bad about using it.

So far, the content I have made emphasizes mostly on ArcGIS Pro or Esri products since using them is how I come to learn more about geology and geography. QGIS was a name I did not learn of in my university years when ArcGIS versions start with the digit 9️⃣, so you can catch my drift.

We can go on and on about theoretical stuff and our smarter pals usually knows what to do when faced with the tools. Unfortunately, I fall in the percentile that needed to land on the job to understand what on earth I am supposed to do. This series of videos are for those who have the same problem as I do and need to see the magic actually happening before knowing what to do. And for the most part, there are so many things to read and try out before you get it right. So hopefully, the demos can kickstart some thoughts or observation in the logic within the software's ecosystem and become more than just a technical power-user.

This week, I touched on some tools that I found helpful when dealing with point vector data, so feel free to check it out 👇🏻

Next week, I'm thinking of exploring some series of point analysis and space time cube is beckoning for me to test it out. Until then, stay cool and drop a word if you need any clarifications on the demos!

📑 International Climate Initiative (IKI) Land Use Plan: Green Initiative in the Heart of Borneo (HoB) Report

Tool: ArcGIS Pro 2.9.3 Technique: Overlay analysis, visualization via remote sensing technique

These maps are developed to aid or supplement the Natural Capital Valuation (NatCap) initiative. As cited by WWF:

An essential element of the Natural Capital Project is developing tools that help decision makers protect biodiversity and ecosystem services.

One of the site included in this initiative by WWF-Malaysia is the Heart of Borneo (HoB). Specifically for this exercise, the visualization of policy and land use eventually become the data input utilized in the tool InVest that generates the models and maps for the economic values of ecosystem services within the landscape of interest.

The generation of the data mainly includes superficial remote sensing to assess the status of the land use in the respective concessions using Sentinel-2 satellite image with specific band combination to identify tree cover, particularly mangrove forest.

Split by Attributes GP tool....when would you actually use this?

There are times when you're making a map but symbolizing using the symbology feature is not enough to characterize the data visually. Thus, having this tool makes cartographical work a little easier by generating copies of the original data, split into separate layers based on the attribute that we need. By doing this, it makes the task of adding the legend much easier in the layout as well.

Most often, when making maps for slide presentation, you would want to segregate data into separate layers with certain uniform values for a certain attribute and a create a new data layer which we can use over and over again.

Although definition query can help with visualizing and showing the features with the attribute value that we want, we may want to create a separate data to avoid compromising the original data or constantly repeating the task of typing/configuring the SQL commands.

This tool is valid for shapefiles and feature classes. Any other data types may need to be converted into those two formats before you can run it. Check out the long-winded demo below:

Since this tool is actually a Python script, it can be integrated into a code for batch geoprocessing or model for iteration over many data layers or interconnection to other tools; automation at its full-on glory! 😁

how to read research paper effectively 📚

I'm hitting the backed-up reading list that I've accumulated in my Zotero. It's annoying and you procrastinate the task of reading as much as possible when you're in that potato phase. I am demotivated, bored, constantly tired, and feel like devoting myself to reading storybooks for life. If I can get paid for all the hours I sleep every time I feel like signing out from life, I could be making a decent living. But, too bad, I don't.

I do not endorse any products or review anything since I feel like, to each, your own. So, I'm not going to tell you what works best or how some tips can magically fix your life. I am lucky that I have an incredible academic supervisor, a flexible boss at work, a very academic-oriented sibling, and a supportive squad of friends. Even with all that, I am still depressed. So, if you're down on the low at the moment, you're not alone. But when you have made a promise, you will look like a total flake if you don't deliver. So, you gotta move your ass anyway, right?

I just started reading papers again and it was so hard. Two weeks go by without me making any progress...just stuck on one paper and not retaining a single piece of information at all. All that forehead and nothing...nothing sticks. So you can say that I am hating life right now. But, today...I manage to reach some sort of compromise with myself and it starts to feel good. So, I would like to share it with you guys who could be struggling to get the engine started as well.

🎯 Literature Review Catalog

My supervisor is an awesome human being. He's the manager/cheerleader/mentor/Allfather/Captain America/Britney Spears to my lackluster academic history. He had been keeping tabs on me despite my intermittent anxious mood that swings like a freaking metronome, so you can say that he practically keeps my boat afloat at this unprecedented time. For our proposal writing (there's a whole army of us that he's supervising), he shared something valuable. The 'Literature Review Catalog'.

Yes. It's an Excel Sheet. Nothing fancy with very normal columns that indicates the papers/resource you've read. Looks simple and useful. The columns are populated as follows:

Year: The year of publication.

Author: Short author list.

Country (Study Area): The areas that are being studied in this research. If you're an Earth Science student like me, you can narrow it down to countries. But I think overall, countries are the most general part of discriminating different studies.

Main Keyword: I create my own keywords to develop my own system of comprehension. But I do create a column for the keywords found in the paper itself.

Issue & Objectives: You can find this information from the Abstract and Introduction part of the paper.

Proposed Method: This can be found in the Results section but I usually scan through the Methodology to add in more information when I do second round scanning of the paper.

Findings & Conclusions: I add in more notes on information that is new to me here in addition to the conclusion. New information can be extracted when you do another once-over of the paper and a conclusion can be obtained from the Conclusion section.

Reference: You can find references that are relevant to your studies from this paper! So why not? Right?

But, it's the laborious work that comes with it that turns my stomach. It scares the hell out of me despite any motivational speech I give myself. But it can all make sense when you pair it with the following method 👇🏻👇🏻👇🏻

🎯 How To Read A Paper Quickly & Effectively | Easy Research Reading Technique

This is the gem my sister told me about yesterday. I brushed it off since it stresses me out to see people sharing their speed-reading techniques, study tips, and how to ace all the subjects in the world or how to get a 4.0 GPA. It really isn't the good people's fault and I blame it on my constantly anxious self. I don't even know what's wrong with me, so...it's not them. It's me. But, here, we're gonna work on 'me'. So, give this 10 minutes video a watch. It's worth it because Dr. Amina Yonis really knows what she's talking about and what's even better, she really is an advocate for effective reading/studying. It's short enough for you to maintain your attention span and you will learn how to actually 'evaluate' your reading materials; are they worth the second shot at reading? Is there any added value to it?

To summarize, what you should look out for:

Title: Read the title and find the keywords

Abstract: Lookout for the results and methods in a simple sentence

Introduction: Read the first and last paragraphs. Most of the time, the first paragraph highlights the satellite view of the crisis and the last paragraph zooms straight for the objective.

Results: Pay attention to the headings since that more or less highlights what was it that they find. If there aren't any headings, try looking at them by paragraph. Scan them through.

Conclusion: This summarizes everything in the research paper.

After the 'Conclusion', you may feel like it is an info/findings that you've already expected or grasped, and you may just proceed and read other new ones in your pile. But if you need to dive deeper, jump to the 'Results' again for the key figures or results and limitations.

So ...

How do you go about reading this and what has it got to do with the 'Literature Review Catalog'? Well, using this efficient reading method and taking out the notes into the columns will help you condense all the important information and helps you stop re-reading constantly the details that are not paramount to your study.

🎯 Forest App

To amp up and see if it was effective, I actually timed myself with the 'Forest App'. I have been estranged from it since my potato phase, but now, it's back to being that BFF I need. It took 10 minutes to go through all the steps and if the paper isn't heavy-laden, 5 minutes to fill it into the 'Literature Review Catalog'. I manage to think and ask questions in my head as I fill in the columns and I believe that's the most important part of the effective reading that we need as someone who's jumping into a very dynamic environment of scrutinizing existing work. You can use any sort of timer to actually give a sense of urgency to your work - it does help to a certain extent. So, if you intend to have fun creating a forest of pretty trees while making good of your focus time, check out this video!

🎯 Reference Manager

And please please please, organize/record your references responsibly using reference management software. Some swears by Mendeley, or the good ol' EndNote. There's also Flowcite and Citationsy. Use them. Don't download those papers indiscriminately without recording the details that can help you sync them straight to your word processor using viable plugins. I personally use Zotero. It comes with a Chrome plugin and Microsoft Word plugin that you can download separately. It's compatible with Linux and iOS operating system. I used to park my work at Mendeley, but I find Zotero more powerful and flexible enough to use and it actually helps me to make the effort to remember what I actually downloaded rather than rely on the convenience of going back and forth to cloud storage. And it's open-source. So, try it out to create an organized library.

To all the aspiring scholars out there, when you win, we all win. Share your phase and troubles with the #studyblr or here with me. Emotional support is important and if the internet does not give you peace of mind, sign out and unplug. It's ok. When you're ready to work, reach out to anyone you think will respond positively and want to help you succeed. We can't all do things alone. So, start that power-up playlist and start working!

Taskade: Multi-platform planner and task manager

The year 2021 is looming over us and I am dying to have some sort of control over what I could be doing for the next 365 days. While 2020 had been a year of 'character building', I discover alot of things about everything around me and myself. For starters, I am an avid planner; surprisingly. But it does not mean that I follow through with them. See what I did right there? I am admitting the truth behind self-study and lifetime of learning.

With alot of things I have planned to breathe new life to my own progress and time management, I went hunting for some interesting stuff in the internet for inspiration and try-outs. And guess what? I found one and I think most people may have been using this already in full swing because the review is 5 ⭐!

🌑🌒🌓🌔🌕🌖🌗🌘🌑

Taskade is simply a project/team management tool. Ah ah ah...before you write me off, hear me out. Taskade is aimed to help teams to plan, organize or manage their tasks and prioritize output for decision-making. It is simply an interactive planner sans organizer sans dashboard that sees where you're at with your work, what you've managed to get done and communicate tasks among people in your team; IF you have a whole team working on some sort of project. Hence, the chat capability that is implemented in this tool.

At my job, I work in a team of only 2 people; me and another colleague, and we're the regional programme unit which is apart of the bigger unit of team mates spread elsewhere in other regions. So, just because your unit is small, it doesn't mean that your task load complements your pint-sized manpower. So, I've been looking for platforms that could help me organize our productivity and ensure high-quality output. Just because technology is more advanced, it doesn'e mean there isn't any learning curve, right? So I tried just about anything under the sun for project/team management; Asana, Slack, Discord, the pre-existing Google..., but none of them could nail all shortcomings precisely; due dates, assignment of tasks, progress, sub-tasks, interactive commenting, multiplatform sync, brainstorming etc. Channels in Slack gives me headache -- same with Discord, and Telegram channels is too 'static' and 'one-way street' for me to view everything.

I found Taskade after trying to find a complementary 'Forest: Focus' extension at the Google Chrome extensions marketplace. There are plenty of interesting high-quality extensions as of late and I am pleasantyl surprised because earlier this year, most of them were quite 'beta' in their functionality. I saw a 'Bullet Journal' extension that someone raved about and another individual commented: 'Isn't this Taskade?'. The curious cat I am, I googled it and was not disappointed. What are the main keywords that hooked me?:

FREE

Google-integrated

Remote work environment advocacy

Multi-platform

What features do Taskade actually have? ✨

Given that it is an All-in-One Collaboration tool, it is understandable if the GUI is pleasing on the eyes. I do understand that first-impression is everything; color, packaging, fore-front information and visual, but it was really the functionality that delivers me to salvation. If you're an active member of Dev.to, then you'll catch feels with this theme that Taskade delivers. Key features in Taskade that you should try out:

Task list

Collaborators invitation feature (no organizational handle required)

Chat feature (with a call feature!)

Workspace feature (nothing new but...I'll get back to this later)

5 interchangeable neural-forest task list templates; List, Board, Action, Mindmap and Org Chart -- seamless with no error.

The capability to utilize this very platform as a presentation or exported into PDF task list printout.

Safe to say, Taskade buried me alive with the curation of beautiful images for the background; again...not relevant but needed to be said.

The Live Demosandbo lets you try it out for yourself although, at first glance, you may be wondering what on earth you are looking at. But it won't take long before you discover that it is quite intuitive.

Did I mention you can download and access it from just about ANYWHERE? Laptops, browser extensions and even smartphone apps. I'm not kidding when I said Taskade is multiplatform; they work on Windows, Mac, Android, iOS and Linux. Currently, I am testing it out using the Chrome extension and installed the app in my Android phone. It works like I expect it to so far.

What is the difference between the FREE and PAID version? 💰💰💰

As I just mentioned, you can sign-up for it for free and use it for life...for free. The priced version is seemingly there to accommodate the file size per upload you require; as of now. For free plan, you can upload 5MB file per upload while the paid version increases the size to 50MB per upload. Both versions offer:

Unlimited storage

Unlimited tasks entry

Unlimited project creation

Unlimited collaborators addition

The development team is currently adding more functionalities such as Project Activity Tracking, Integration to Dropbox, Google Drive and One Drive as well as Email Integration -- available for free.

Although it is mentioned that the free version of Taskade includes unlimited tasks, collaborators and all essential features, it was also mentioned that you will need to upgrade if you exceed the workspace limits which doesn't actually have any entailing elaborations which I will try to dig soon enough. But safe to say that if you are a single person using this tool, you are considered a team of 'one' where your shared projects in workspace to your 'editors' are still considered free. Only workspace the addition of workspace members are billed. This may imply that there are certain limits to how many individuals you can add into your workspace before you are required to upgrade. So far, visually, I see that the limit may be 2 people that makes up to 3 people per workspace (including yourself). You can find some details to pricing and FAQs here:

Taskade | Simple Pricing

Personally, I don't think USD5 is a hard bargain if you're self-employed and work with external parties collaboratively. If you're apart of an organization, feel free to ask for demo from them. Discount is possible if you're from a nonprofit or educational institution.

How I use Taskade? ☕

Well, given that it was free to sign-up, I tried it out straight away and I'm happy to report that I successfully managed to use it without having to google nor view any how-tos. That is a good thing! In fact, I am quite elated with just how easy it is to use this tool that I have used my personal email to help centralize and manage my work and personal work side-by-side. If you prefer some satellite view of your progress and all the task you need to complete to clear off certain objective, this is not a bad organization.

So I created 2 workspace: one for work and one for my personal tasks. Then I just collate all my tasks into monthly projects.

My personal tasks involve me updating my study progress and curating stuff I like online into my Tumblr blog.

Create studyblr workspace

Create new project in the studyblr workspace to organize and brainstorm Tumblr contents I plan to create and post: Tumblr: 2021/01.

Utilize the Mindmap template from all the options of templates shared and start creating the and organizing the content I want and tasks I need to execute to develop them.

Et voila! There all there is to it! It is easy peasy and you can start adding due dates as reminders and links as resources as well as hashtags for filtering in future. Check out some drafting I did so far in the screenshots below!

For more updates, check out their Updates page that fully utilizes Taskade to share all the updates straight from December 2017 till present and the chat function is there available for you to ask the Taskade team about the feature updates directly. Now that's awesome cause you know something's good if the one who makes them, actually uses them.😎😎😎

Python: Geospatial Environment Setup (Part 2)

Python: Geospatial Environment Setup (Part 2)

Hey again folks! I am here for the second part of Python environmental setup for a geospatial workspace. I published the first part of this post two weeks ago. So if you've not yet read that, I'll catch you up to speed with our checklist:

Install Python ☑

Install Miniconda ☑

Install the basic Python libraries ☑

Create a new environment for your workspace

Install geospatial Python libraries

🗃 Create a new environment for your workspace

Since we have actually manually set up our base environment quite thoroughly with all the basic libraries needed, to make our work easier, we can just clone the base environment and install all the additional essential libraries needed for geospatial analysis. This new environment will be called geopy. Feel free to use a name you identify most with.

Why don't we just create a new environment? Well, it means we have to start installing the Python libraries again from scratch. Although it is no trouble to do so, we want to avoid installing so many libraries all at once. As I mentioned in Part 1, there is always a risk where incomplete dependencies in one library will affect the installation of other libraries that you intend to install in one go. Since we already have a stable and usable base environment, we can proceed to use it as a sort of pre-made skeleton that we will build our geospatial workspace with.

1️⃣ At the Anaconda Command Prompt, type the following:

2️⃣ Press Enter and the environment will be clone for you. Once it is done, you can use the following command to check the availability of your environment 👇🏻

You should be able to see your geopy environment listed along with the base environment.

👩🏻‍💻 Install geospatial Python libraries

Here we will proceed with the installation of a few geospatial Python libraries that are essential to reading and exploring the vectors and rasters.

🔺 fiona: This library is the core that some of the more updated libraries depend on. It is a simple and straightforward library that reads and writes spatial data in the common Python IOs without relying on the infamous GDAL's OGR classes.

🔺 shapely: shapely library features the capability to manipulate and edit spatial vector data in the planar geometric plane. It is one of the core libraries that recent geospatial Python libraries rely on to enable the reading and editing of vector data.

🔺 pyproj: is the Python interface for the cartographic projections and coordinate system libraries. Another main library that enables the 'location' characteristics in your spatial data to be read.

🔺 rasterio: reads and writes raster formats and provides a Python API based on Numpy N-dimensional arrays and GeoJSON.

🔺 geopandas: extends the pandas library to allow spatial operations on the geometric spatial data i.e shapefiles.

💀 As you might have noticed, we won't be doing any direct gdal library installation. It's mainly due to the fact that its installation is a process that seems to be accompanied by misery at every turn and involved workarounds that are pretty inconsistent for different individuals. Does it mean that we won't be using it for our Pythonic geospatial analysis? Heck no. But we will be taking advantage of the automatic dependency installation that comes with all the libraries above. The rasterio library depends on gdal and by installing it, we integrate the gdal library indirectly into our geospatial environment. I found that this method is the most fool-proof. Let's proceed to the installation of these libraries.

1️⃣ At the Anaconda Command Prompt, should you start from the beginning, ensure that your geopy environment is activated. If not, proceed to use the following command to activate geopy.

Once activated, we can install the libraries mentioned one after another. Nevertheless, you also have the option of installing them in one go directly using a single command 👇🏻

💀 geopandas is not included in this line-up NOT because we do not need it. It's another temperamental library that I prefer to isolate and install individually. If gdal is a rabid dog...then geopandas is a feral cat. You never know how-when-why it doesn't like you and forces a single 10-minute installation drag to hours.

3️⃣ Once you're done with installing the first line-up above, proceed with our feral cat below 👇🏻

4️⃣ Use the conda list command again to check if all the libraries have been installed successfully.

🎉Et voilá! Tahniah! You did it!🎉

🎯 The Jupyter Notebook

It should be the end of the road for the helluva task of creating the geospatial environment. But you're going to ask how to start using it anyway. To access this libraries and start analyzing, we can easily use the simple and straight-forward Jupyter Notebook. There are so many IDE choices out there but for data analysis, Jupyter Notebook suffices for me so far and if you are not familiar with Markdown, this tool will ease you into it slowly.

Jupyter Notebook can be installed in your geopy environment as follows:

And proceed to use it by prompting it open via the command prompt

It ain't that bad, right? If you're still having problems with the steps, do check out the real-time video I created to demonstrate the installation. And feel free to share with us what sort of problems you have encountered and the workaround or solutions you implemented! It's almost never a straight line with this, trust me. As mentioned in the previous post, check out the quick demo below 👇🏻

See you guys again for another session on geospatial Python soon!

Uninspired

I am a reckless uninspired person. I call myself a map-maker but I don't really get to make maps for reasons that I don't think I should venture outside of my requesters' requests. But mostly, I am compelled to get it right and I feel good if I can deliver what they need. The thing is, I no longer get spontaneously inspired to make maps anymore. Just as the rules become clearer the more you read books on cartography, fear just crop themselves up like 'Plant vs Zombies' 🌱 in PlayStation.

So, I am scared that I'm beginning to wear off my excitement about making map; really making them and not just knowing how to make them.

What sort of idea is great? I mean, what should I focus on trying to make? There are so many data out there that what I will attempt may be missing the train or just pale in comparison to other incredible work. I don't really mind it but I'm not that young to not understand self-esteem does ease the thinking process.

Can't say much, I mean...30 Days of Map Challenge hasn't been all that well with me. I should've prepared something before the event event started. I quit after the 3rd challenge cause I overthink and get panic attacks every time I feel I'm doing stuff half-ass.

Despite all that, I am lucky to have aggressively supportive siblings. They just can't seem to stop the tough love and always kicking me to just barf something out.

'It's the process that matters!'

When did I start forgetting how wonderful the process, huh?