Jump to content

Technology:Databricks: Difference between revisions

From Codex
No edit summary
No edit summary
Line 11: Line 11:
# added volume/directory
# added volume/directory
#* test20/default/inventory/all-stock
#* test20/default/inventory/all-stock
#* 78 files I think, each about 65MB JSON
#* 78 files I think, each about 65MB JSON [[File:db-infinite-json-files.jpg|200px|thumb|left|Upload files to volume]]

Revision as of 21:51, 27 September 2024

Background

Friday Sept 27th decided to learn what databricks is

Setup

https://docs.databricks.com/en/getting-started/onboarding-account.html
  1. create stack - done
  2. create compute resource - done / started serverless starter warehouse
  3. connect workspace to data sources
    • s3://.../374226360171826
  4. added volume/directory