AI Inference

Introduction

The AI Marketplace Playground lets you test and interact with AI models without coding — including text generation, text-to-speech, speech-to-text, vision tasks, and embeddings.

• On the homepage, click “Playground” in the top navigation bar (between Pricing and Support Center).

• Click Get API Key to go to the My API Key page, where you can create or manage your API keys.

• Click View Code to open a pop-up showing sample code snippets (available in cURL, Python, and Node.js) along with an example response for your request.

1. Large Language Model (LLM)

Description:
A text-based assistant trained on a huge amount of information (books, websites, articles, conversations). It can understand your request and reply with natural, human-like text.

Quick Action Templates Available:

• Create a blog outline
• Create a go-to-market plan
• Summarize this report in bullet points
• Help me prepare talking points for my meeting
• Professionalize my email
• Write a to-do list for a personal project

Steps:

1. Click on the task that best fits your needs. The system will automatically prepare a response based on your input.
2. Type your question, topic, or specific request related to the selected task into the text box.
3. Click Send → The result will appear on the right.

Advanced Settings (left panel):

• System prompt – set style/behavior of the assistant.
• Temperature, Max output tokens, Top P, Top K, Penalties – fine-tune creativity, length, and randomness.

2. Text to Speech Model (TTS)

Description:
Converts written text into spoken audio.

Steps:

1. Select the type of voice in the Voice dropdown.
2. Select the speed of the voice in the Speed dropdown.
3. Select the language in the Language dropdown.
4. Enter up to 500 characters in Text input.
5. Click Run → The system will generate the audio file, which can be played or downloaded.

3. Speech to Text Model (STT)

Description:
Converts spoken audio into written text.

Steps:

1. Select the Model from the dropdown.
2. Choose Response format (e.g., json or text).
3. Set the Source language.
4. Select the Task:
   • Transcription – converts speech to text.
   • Translation – converts speech to text in another language.
5. Upload or record audio (supported formats: MP3/WAV, max length 15s).
6. Click Run → The transcribed or translated text will appear in the Result section.

4. Vision Language Model (VLM)

Description:
An assistant that combines computer vision (understanding images) and natural language processing (understanding text) to make sense of the world in a more human-like way.

Steps:

1. Upload your image (JPEG, PNG, JPG, max 2 files, 20 MB each).
2. Ask a question about your image in the text box.
3. Click Run → The model will respond based on the image content.

5. Embedding Model

Description:
Embedding models are transformer-based neural networks that transform chunks of documents (passages of text) into a numeric representation or vector.
These vectors capture the semantic meaning of text and are used for tasks like search, recommendation, and similarity comparison.

Steps:

1. Select the type of input you want to test in the Input type dropdown.
2. Select the desired output format for the embedding in the Encoding format dropdown.
3. Choose how to handle input that exceeds the token limit in the Truncate dropdown.
4. Enter up to 500 characters in Text input.
5. Click Run → The system will display the embedding vector (numerical representation) in the Result section.

Note:
Guardrail feature is coming soon to enhance content safety.

6. Extra Controls in the Left Panel

• System prompt: Guide the model’s behaviour and style.
• Enable streaming: Show partial results as they are generated.
• Stop sequences: Cut off the model’s response at specific words or phrases.
• Fine-tune this model: Link to start customizing the model for your own use case.