Technology:Databricks: Difference between revisions
No edit summary |
No edit summary |
||
| Line 6: | Line 6: | ||
[[File:db-infinite-json-files.png|200px|thumb|right|Upload files to volume]] | [[File:db-infinite-json-files.png|200px|thumb|right|Upload files to volume]] | ||
[[File:db-notebook.png|200px|thumb|right|processing with notebook]] | |||
# create stack - done | # create stack - done | ||
# create compute resource - done / started serverless starter warehouse | # create compute resource - done / started serverless starter warehouse | ||
Revision as of 22:14, 27 September 2024
Background
Friday Sept 27th decided to learn what databricks is
Setup
https://docs.databricks.com/en/getting-started/onboarding-account.html
- create stack - done
- create compute resource - done / started serverless starter warehouse
- connect workspace to data sources
- s3://.../374226360171826
- added volume/directory
- test20/default/inventory/all-stock
- 78 files I think, each about 65MB JSON