GenAI functions
When to use GenAI functions#
Use GenAI functions when you need to:
- Extract specific information from AI conversation logs, such as user prompts, assistant responses, or system prompts
- Calculate token costs and usage metrics for LLM API calls
- Analyze conversation structure and flow, including turn counts and message roles
- Process and filter conversation messages based on roles or content
- Determine pricing information for different AI models
- Detect truncation or tool calls in AI responses
Available GenAI functions#
| Function | Description |
|---|---|
| genai_concat_contents | Concatenates message contents from a conversation array |
| genai_conversation_turns | Counts the number of conversation turns |
| genai_cost | Calculates the total cost for input and output tokens |
| genai_estimate_tokens | Estimates the number of tokens in a text string |
| genai_extract_assistant_response | Extracts the assistant’s response from a conversation |
| genai_extract_function_results | Extracts function call results from messages |
| genai_extract_system_prompt | Extracts the system prompt from a conversation |
| genai_extract_tool_calls | Extracts tool calls from messages |
| genai_extract_user_prompt | Extracts the user prompt from a conversation |
| genai_get_content_by_index | Gets message content by index position |
| genai_get_content_by_role | Gets message content by role |
| genai_get_pricing | Gets pricing information for a specific model |
| genai_get_role | Gets the role of a message at a specific index |
| genai_has_tool_calls | Checks if messages contain tool calls |
| genai_input_cost | Calculates the cost for input tokens |
| genai_is_truncated | Checks if a response was truncated |
| genai_message_roles | Extracts all message roles from a conversation |
| genai_output_cost | Calculates the cost for output tokens |
Browse by theme#
Conversation checks
Count conversation turns and check for tool calls or truncated responses.
Cost and tokens
Estimate tokens and compute the input, output and total cost of GenAI calls.
Extract messages
Pull the system prompt, user prompt, assistant response, tool calls and roles out of GenAI conversations.