WOLFRAM

Wolfram Language & System Documentation Center

"Groq" (Service Connection)

This service connection requires LLM access »
Use the Groq API with the Wolfram Language.

Connecting & Authenticating

ServiceConnect["Groq"] creates a connection to the Groq API. If a previously saved connection can be found, it will be used; otherwise, a new authentication request will be launched.
Use of this connection requires internet access and a Groq account.

Requests

ServiceExecute["Groq","request",params] sends a request to the Groq API, using parameters params. The following gives possible requests.
Request:

"TestConnection" — returns Success for working connection, Failure otherwise

Text

Request:

"Chat" — create a response for the given chat conversation

Parameters:
  • "Messages"(required)a list of messages in the conversation, each given as an association with "Role" and "Content" keys
    "FrequencyPenalty"Automaticpenalize tokens based on their existing frequency in the text so far (between -2 and 2)
    "MaxTokens"Automaticmaximum number of tokens to generate
    "Model"Automaticname of the model to use
    "N"Automaticnumber of completions to return
    "PresencePenalty"Automaticpenalize new tokens based on whether they appear in the text so far (between -2 and 2)
    "StopTokens"Automaticstrings where the API will stop generating further tokens
    "Stream"Falsereturn the result as server-sent events
    "Temperature"Automaticsampling temperature
    "ToolChoice"Automaticwhich (if any) tool is called by the model
    "Tools"Automaticone or more LLMTool objects available to the model
    "TotalProbabilityCutoff"Automatican alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with the requested probability mass
    "User"Automaticunique identifier representing the end user

    • Audio

    Request:

    "AudioTranscription" — transcribe an audio recording into the input language

    Parameters:
  • "Audio"(required)the Audio object to transcribe
    "Language"Automaticlanguage of the input audio
    "Model"Automaticname of the model to use
    "Prompt"Noneoptional text to guide the model's style or continue a previous audio segment
    "Temperature"Automaticsampling temperature (between 0 and 1)
    "TimestampGranularities"Automaticthe timestamp granularity of transcription (either "word" or "segment")
    • Request:

    "AudioTranslation" — translate an audio recording into English

    Parameters:
  • "Audio"(required)the Audio object to translate
    "Model"Automaticname of the model to use
    "Prompt"Noneoptional text to guide the model's style or continue a previous audio segment
    "Temperature"Automaticsampling temperature (between 0 and 1)

    • Model Lists

    Request:

    "ChatModelList" — list models available for the "Chat" request

    Examples

    open all close all

    Basic Examples  (1)

    Create a new connection:

    Wolfram Language code: groq = ServiceConnect["Groq"]

    Generate a response from a chat:

    Wolfram Language code: ServiceExecute[groq, "Chat", {"Messages" -> {<|"Role" -> "User", "Content" -> "Hello there!"|>}}]

    Scope  (5)

    Connection  (1)

    Test the connection:

    Wolfram Language code: ServiceExecute["Groq", "TestConnection"]

    Text  (2)

    Chat  (1)

    Respond to a chat containing multiple messages:

    Wolfram Language code: ServiceExecute["Groq", "Chat", {"Messages" -> { <|"Role" -> "User", "Content" -> "What's the tallest mountain?"|>, <|"Role" -> "Assistant", "Content" -> "The highest mountain in the world is Mount Everest."|>, <|"Role" -> "User", "Content" -> "How tall is it?"|> }}]

    ChatModelList  (1)

    Look up the available chat models list:

    Wolfram Language code: ServiceExecute["Groq", "ChatModelList"]

    Audio  (2)

    AudioTranscription  (1)

    Transcribe an Audio object:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranscription", {"Audio" -> ExampleData[{"Audio", "MaleVoice"}]}]

    Use a prompt to provide context for the transcription:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranscription", {"Audio" -> ExampleData[{"Audio", "MaleVoice"}], "Prompt" -> "in a welsh farm, just before noon"}]

    Transcribe a recording made in a different language:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranscription", {"Audio" -> \!\(\*AudioBox["![Embedded Audio Player](audio://content-fr530)"]\), "Language" -> Entity["Language", "Italian::39fbj"]}]

    Increase the temperature used for the sampling:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranscription", {"Audio" -> ExampleData[{"Audio", "MaleVoice"}], "Temperature" -> .9}]

    AudioTranslation  (1)

    Translate an Audio object into English:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranslation", {"Audio" -> ExampleData[{"Audio", "MaleVoice"}]}]

    Use a prompt to provide context for the translation:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranslation", {"Audio" -> \!\(\*AudioBox["![Embedded Audio Player](audio://content-fr530)"]\), "Prompt" -> "in a welsh farm, just before noon"}]

    Increase the temperature used for the sampling:

    Wolfram Language code: ServiceExecute["Groq", "AudioTranscription", {"Audio" -> ExampleData[{"Audio", "MaleVoice"}], "Temperature" -> 1}]