Data: Difference between revisions
No edit summary |
No edit summary |
||
| Line 9: | Line 9: | ||
27. I imported 600MB of json inventory data into [[Technology:Databricks]] as my first poc. I learned that my data was incomplete 😱 | 27. I imported 600MB of json inventory data into [[Technology:Databricks]] as my first poc. I learned that my data was incomplete 😱 | ||
=====October | =====October===== | ||
3. Trying to find a good starting point, I landed on https://www.reddit.com/r/dataengineering/ | 3. Trying to find a good starting point, I landed on https://www.reddit.com/r/dataengineering/ which lead me to https://dataengineering.wiki/Learning+Resources which lead me to https://dezoomcamp.streamlit.app/. I'm currently on Module 2 https://dezoomcamp.streamlit.app/Module%202%20Workflow%20Orchestration | ||
I need to investigate what exactly the following things are, and how to use them (or if I want to use them) | |||
- airtable | |||
- maige (orchestration) | |||
Revision as of 20:58, 3 October 2024
My Data Journey
Started September 27th 2024 whilst attempting to learn Technology:Databricks
I want to document my journey here.
My Data Journal
2024
September
27. I imported 600MB of json inventory data into Technology:Databricks as my first poc. I learned that my data was incomplete 😱
October
3. Trying to find a good starting point, I landed on https://www.reddit.com/r/dataengineering/ which lead me to https://dataengineering.wiki/Learning+Resources which lead me to https://dezoomcamp.streamlit.app/. I'm currently on Module 2 https://dezoomcamp.streamlit.app/Module%202%20Workflow%20Orchestration
I need to investigate what exactly the following things are, and how to use them (or if I want to use them) - airtable - maige (orchestration)