Implementing a Chatbot for Slack using MindsDB and OpenAI's GPT Model

The objective of this tutorial is to create an AI-powered personalized chatbot by utilizing the MindsDB’s Slack connector, and combining it with OpenAI’s GPT-4 Model.

To illustrate practically, we will be having a Slack bot - @Whiz_Fizz - which will reply to the user’s queries with proper context and with a unique persona while responding. It is a weird magician 🪄 and a Space Science Expert! Let’s see how it responds.

Before Jumping more into it. Let’s first see how to create a bot and connect it to our Slack Workspace.

Getting Started

• Create an account on MindsDB cloud (if you don’t have one yet).
• Create a Slack Account and follow this instruction to connect Slack to MindsDB.
• Go to your MindsDB SQL Editor

MindsDB is a famous open-source application used for simplifying the use of Machine Learning in modern-day applications without the need for any external tool by making forecasts on the Data available in your database. It lets you build any Generative AI application with minimal steps required.

Usage

This query will create a database called mindsdb_slack and channels table automatically.

Here is how to retrieve the 10 messages after specific timestamp:

SELECT *
FROM mindsdb_slack.channels
WHERE channel="<channel-name>" AND message_created_at > '2023-07-25 00:13:07'
LIMIT 10;

Please change the channel-name in the WHERE clause to the channel where, you added the bot in your Slack Workspace.

However, you can also retrieve messages in alphabetical order by using:

SELECT *
FROM mindsdb_slack.channels
WHERE channel="<channel-name>"
ORDER BY messages ASC
LIMIT 5;

By default, it retrieves by the order the messages were sent, unless specified ascending/descending.

Here is how to post messages:

INSERT INTO mindsdb_slack.channels (channel, message)
VALUES
    ("<channel-name>", "Hey MindsDB, Thanks to you! Now I can respond to my Slack messages through SQL Queries. 🚀 "),
    ("<channel-name>", "It's never been that easy to build ML apps using MindsDB!");

Whoops! Sent it by mistake, No worries, use this to delete a specific message

DELETE FROM mindsdb_slack.channels
WHERE channel = "<channel-name>" AND ts = "1688863707.197229";

Now, let’s roll up our sleeves and start building the GPT-4 Model together. Here’s how we can do it:

1. Crafting the GPT-4 Model:

Generating a Machine Learning model with MindsDB feels like taking a thrilling elevator ride in Burj Khalifa (You don’t realize, that you made it)!

Here gpt_model represents our GPT-4 Model.

Before creating an OpenAI model, please create an engine, providing your OpenAI API key:

CREATE ML_ENGINE openai_engine
FROM openai
USING
	api_key = 'your-openai-api-key';

CREATE MODEL mindsdb.gpt_model
PREDICT response
USING
engine = 'openai_engine',
max_tokens = 300,
model_name = 'gpt-4',
prompt_template = 'From input message: {{messages}}\
write a short response to the user in the following format:\
Hi, I am an automated bot here to help you, Can you please elaborate the issue which you are facing! ✨🚀 ';

If you are using MindsDB on Docker or if you want to use your own OpenAI API Key, simply remove -- from api_key argument.

The critical attribute here is prompt_template where we tell the GPT model, how to respond to the questions asked by the user, feel free to change any values passed in the columns, from our example, {{messages}}, will be replaced by the WHERE clause provided in the query. Let’s see how it works:

SELECT
  messages, response
FROM mindsdb.gpt_model
WHERE messages = 'Hi, can you please explain me more about MindsDB?';

2. Feeding Personality into Our Model

Alright, so the old model’s replies were good. But hey, we can use some prompt template tricks to make it respond the way we want. Let’s do some Prompt Engineering.

Now, let’s make a model called whizfizz_model with a prompt template that gives GPT a wild personality that eludes a playful and magical aura. Imagine scientific knowledge with whimsical storytelling to create a unique and enchanting experience. We’ll call him WhizFizz:

CREATE MODEL mindsdb.whizfizz_model
PREDICT response
USING
engine = 'openai_engine',
max_tokens = 300,
api_key = 'your openai key,
model_name = 'gpt-4', -- you can also use 'text-davinci-003' or ''
prompt_template = 'From input message: {{messages}}\
write a short response in less than 40 words to some user in the following format:\
Hi there, WhizFizz here! <respond with a mind blowing fact about Space and describe the response using cosmic and scientific analogies, where wonders persist. In between quote some hilarious appropriate raps statements based on the context of the question answer as if you are a Physics Space Mad Scientist who relates everythign to the Universe and its strange theories. So lets embark on a journey, where science and magic intertwine. Stay tuned for more enchantment! ✨🚀 -- mdb.ai/bot by @mindsdb';

Let’s test this in action:

SELECT
  messages, response
FROM mindsdb.whizfizz_model
WHERE messages = 'Hi, can you please explain me more about MindsDB?';

You see the difference! Now, I’m getting excited, let’s try again.

SELECT
  messages, response
FROM mindsdb.whizfizz_model
WHERE messages = 'if a time-traveling astronaut had a dance-off with a black hole, what mind-bending moves would they showcase, and how would gravity groove to the rhythm?!';

3. Let’s Connect our GPT Model to Slack!

The database has channels table. This table can be used to search for channels, messages, and timestamps, as well as to post messages into slack channels. These functionalities can also be done by using Slack API or Webhooks.

Let’s query the user’s question and see how our GPT model responds to it, by joining the model with the channels table:

SELECT
    t.channel as channel,
    t.messages as input_text, 
    r.response as message
FROM mindsdb_slack.channels as t
JOIN mindsdb.whizfizz_model as r
WHERE t.channel = '<channel-name>'
LIMIT 3;

4. Posting Messages using SQL

We want to respond to the user’s questions by posting the output of our newly created WhizFizz Model. Let’s post the message by querying and joining the user’s questions to our model:

INSERT INTO mindsdb_slack.channels(channel, message)
  SELECT
    t.channel as channel,
    t.messages as input_text, 
    r.response as message
  FROM mindsdb_slack.channels as t
  JOIN mindsdb.whizfizz_model as r
  WHERE t.channel = '<channel-name>'
  LIMIT 3;

Works like a charm!!

5. Let’s automate this

We will CREATE JOB that means the query which we will give, will execute after some interval. Let’s schedule a job every hour. The job will do the following:

1. Check for new messages
2. Generate an appropriate response
3. Post the response into the channel

Let’s do it in single SQL statement:

CREATE JOB mindsdb.gpt4_slack_job AS (
   -- insert into channels the output of joining model and new responses
  INSERT INTO mindsdb_slack.channels(channel, message)
  SELECT
    t.channel as channel,
    t.messages as input_text, 
    r.response as message
  FROM mindsdb_slack.channels as t
  JOIN mindsdb.whizfizz_model as r
  WHERE t.channel = '<channel-name>' AND t.message_created_at > "2023-07-25 05:22:00" AND t.message_created_at > "{{PREVIOUS_START_DATETIME}}"
  LIMIT 10;
)
EVERY hour;

That sums up the tutorial! Here it will continually check for new messages posted in the channel and will respond to first 10 messages through responses generated by OpenAI’s GPT model in the style of WhizFizz.

To check the jobs and jobs_history, we can use the following:

SELECT * FROM jobs WHERE name="gpt4_slack_job";
SELECT * FROM jobs_history WHERE name="gpt4_slack_job";

To stop the sheduled job, we can use the following:

DROP JOB gpt4_slack_job;

What’s next?

Check out How to Generate Images using OpenAI with MindsDB to see another interesting use case of OpenAI integration.