Skip to content

Commit

Permalink
Add troubleshooting section to Bedrock and adapt default model
Browse files Browse the repository at this point in the history
  • Loading branch information
silv-io committed Dec 4, 2024
1 parent 2ee0afb commit 0ad0998
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 1 deletion.
2 changes: 1 addition & 1 deletion content/en/references/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ This section covers configuration options that are specific to certain AWS servi
| Variable | Example Values | Description |
| - | - | - |
| `BEDROCK_PREWARM` | `0` (default) \| `1` | Pre-warm the Bedrock engine directly on LocalStack startup instead of on demand. |
| `DEFAULT_BEDROCK_MODEL` | `mistral` (default) | The model to use to handle text model invocations in Bedrock. Any text-based model available for Ollama is usable. |
| `DEFAULT_BEDROCK_MODEL` | `smollm2` (default) | The model to use to handle text model invocations in Bedrock. Any text-based model available for Ollama is usable. |

### BigData (EMR, Athena, Glue)

Expand Down
10 changes: 10 additions & 0 deletions content/en/user-guide/aws/bedrock/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -127,6 +127,16 @@ $ awslocal bedrock create-model-invocation-job \

The results will be at the S3 URL `s3://out-bucket/12345678/batch_input.jsonl.out`

## Troubleshooting

Users of Docker Desktop on macOS might run into the issue of Bedrock becoming unresponsive after some usage.
A common reason for that is insufficient storage or memory space in the Docker Desktop VM.
To resolve this issue you can increase those amounts directly in Docker Desktop or clean up unused artifacts with the Docker CLI like this

{{< command >}}
$ docker system prune
{{< / command >}}

## Limitations

* At this point, we have only tested text-based models in LocalStack.
Expand Down

0 comments on commit 0ad0998

Please sign in to comment.