Get Even More Visitors To Your Blog, Upgrade To A Business Listing >>

Spatial Data Engineering with Typescript

Tags: spatial

Member-only storySutan MuftiFollowTowards Data Science--ShareWe can think of data as if it were water and companies as towns. Just as a town grows as the population grows and needs more water to serve its residents, a company, as it gets bigger, requires a ready to consume data to support its operations. Such companies require a data pipeline system that acts like the pipes and infrastructure that bring water to homes in a town. In our data analogy, data engineers are the people who build and maintain these data pipelines. It is quite straight forward for regular array or table like data, however, it is a bit more complicated when it comes to Spatial data.Spatial data is a bit different compared to regular data; it contains spatial attributes. These attributes allow us to establish spatial relationship; also known as geospatial topology. Even though two tables don’t have primary keys and foreign keys, we can still join them if they both have the spatial attributes. If we visualise the spatial attribute, we have a map!towardsdatascience.comBuilding spatial data pipelines differs from creating ordinary data pipelines. In this case, we primarily handle spatial data attributes using spatial SQL, which is a less common skill within the data scientist community. Once a data pipe line is built, data analysts can proceed in analysing the spatial data from the data pipeline. This means data analyst can focus on generating spatial insights without having to worry about data availability. This also means that maps can be generated automatically with the latest spatial data.This article discusses how to build spatial data pipelines using typescript and nodeJS. We can call this an ETL (Extract, Transform, Load) process but with spatial data. First, we will walk through how we can fetch the data from the source using typescript (Extract). We will then transform this data into the right structure for storage…----Towards Data Sciencesoftware engineering for spatial data. Towards sustainable energy development. MSc Infrastructure Planning, UCL; Urban planning ITB. about.sutan.co.uk/Sutan MuftiinTowards Data Science--Zoumana KeitainTowards Data Science--12Bex T.inTowards Data Science--11Sutan MuftiinSutanInsight--Coding BeautyinDev Genius--7Dmitry KruglovinBetter Programming--48Kim Witten, PhD--144Chris KarvouniarisinITNEXT--4Stan PugsleyinTowards Data Science--9Jeswanth ReddyinVersion 1--8HelpStatusWritersBlogCareersPrivacyTermsAboutText to speechTeams



This post first appeared on VedVyas Articles, please read the originial post: here

Share the post

Spatial Data Engineering with Typescript

×

Subscribe to Vedvyas Articles

Get updates delivered right to your inbox!

Thank you for your subscription

×