Skip to content

Commit

Permalink
Add a notes md file
Browse files Browse the repository at this point in the history
  • Loading branch information
dbirks committed Jun 11, 2024
1 parent 0326c6e commit 0c23876
Showing 1 changed file with 57 additions and 0 deletions.
57 changes: 57 additions & 0 deletions src/fabric-runtime/NOTES.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
## Examples

Get started with a `.devcontainer/devcontainer.json` like:

```json
{
"name": "Fabric Runtime 1.2",
"image": "ghcr.io/e-gineering/devcontainer-images/fabric-runtime:1.2"
}
```

Or install some additional Python packages by creating a `.devcontainer/requirements.txt` and installing them with:

```json
{
"name": "Fabric Runtime 1.2",
"image": "ghcr.io/e-gineering/devcontainer-images/fabric-runtime:1.2",
"onCreateCommand": "pip install -r .devcontainer/requirements.txt"
}
```

## About

These images are created with PySpark workloads in mind, so you'll find Python and Java installed, but not Scala or R at this point.

You can find the image sources here: https://github.com/e-gineering/devcontainer-images/tree/main/src/fabric-runtime

## Versions

The software versions are pinned to track the versions listed in the Microsoft [docs](https://learn.microsoft.com/en-us/fabric/data-engineering/runtime).

### Fabric Runtime 1.3

- Apache Spark 3.5.1
- Java 11
- Python 3.11
- Delta Lake 3.1.0

Microsoft docs for 1.3: https://learn.microsoft.com/en-us/fabric/data-engineering/runtime-1-3

### Fabric Runtime 1.2

- Apache Spark 3.4.1
- Java 11
- Python 3.10
- Delta Lake 2.4.0

Microsoft docs for 1.2: https://learn.microsoft.com/en-us/fabric/data-engineering/runtime-1-2

### Fabric Runtime 1.1

- Apache Spark 3.3.1
- Java 8
- Python 3.10
- Delta Lake 2.2.0

Microsoft docs for 1.1: https://learn.microsoft.com/en-us/fabric/data-engineering/runtime-1-1

0 comments on commit 0c23876

Please sign in to comment.