Large Language Models
Anthropic
This documentation describes the integration of MindsDB with Anthropic, an AI research company. The integration allows for the deployment of Anthropic models within MindsDB, providing the models with access to data from various data sources.
Prerequisites
Before proceeding, ensure the following prerequisites are met:
- Install MindsDB locally via Docker or use MindsDB Cloud.
- To use Anthropic within MindsDB, install the required dependencies following this instruction.
- Obtain the Anthropic API key required to deploy and use Anthropic models within MindsDB. Follow the instructions for obtaining the API key.
Setup
Create an AI engine from the Anthropic handler.
CREATE ML_ENGINE anthropic_engine
FROM anthropic
USING
api_key = 'api-key-value';
Create a model using anthropic_engine
as an engine.
CREATE MODEL anthropic_model
PREDICT target_column
USING
engine = 'anthropic_engine', -- engine name as created via CREATE ML_ENGINE
column = 'column_name', -- column that stores input/question to the model
max_tokens = <integer>, -- max number of tokens to be generated by the model (default is 100)
model = 'model_name'; -- choose one of 'claude-1' or 'claude-2' (default is 'claude-2')
Usage
The following usage examples utilize anthropic_engine
to create a model with the CREATE MODEL
statement.
Create and deploy the Anthropic model within MindsDB to ask any question.
CREATE MODEL anthropic_model
PREDICT answer
USING
engine = 'anthropic_engine',
column = 'question';
Query the model to get predictions.
SELECT question, answer
FROM anthropic_model
WHERE question = 'Where is Stockholm located?';
Here is the output:
+-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| question | answer |
+-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
| Where is Stockholm located? | Stockholm is the capital and largest city of Sweden. It is located on Sweden's south-central east coast, where Lake Mälaren meets the Baltic Sea. |
+-----------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------+
Next Steps
Go to the Use Cases section to see more examples.