Data

My Data Journey

Started September 27th 2024 whilst attempting to learn Technology:Databricks

I want to document my journey here.

My Data Journal

2024

September

• 27. I imported 600MB of json inventory data into Technology:Databricks as my first poc. I learned that my data was incomplete 😱

October

• 3. Trying to find a good starting point, I landed on https://www.reddit.com/r/dataengineering/ which lead me to https://dataengineering.wiki/Learning+Resources which lead me to https://dezoomcamp.streamlit.app/. I'm currently on Module 2 https://dezoomcamp.streamlit.app/Module%202%20Workflow%20Orchestration
  • I need to investigate what exactly the following things are, and how to use them (or if I want to use them)
    • airtable
    • maige (orchestration)