GenAI functions
When to use GenAI functions#
Use GenAI functions when you need to:
- Extract specific information from AI conversation logs, such as user prompts, assistant responses, or system prompts
- Calculate token costs and usage metrics for LLM API calls
- Analyze conversation structure and flow, including turn counts and message roles
- Process and filter conversation messages based on roles or content
- Determine pricing information for different AI models
- Detect truncation or tool calls in AI responses
Available GenAI functions#
| Function | Description |
|---|---|
| genai_concat_contents | Concatenates message contents from a conversation array |
| genai_conversation_turns | Counts the number of conversation turns |
| genai_cost | Calculates the total cost for input and output tokens |
| genai_estimate_tokens | Estimates the number of tokens in a text string |
| genai_extract_assistant_response | Extracts the assistant’s response from a conversation |
| genai_extract_function_results | Extracts function call results from messages |
| genai_extract_system_prompt | Extracts the system prompt from a conversation |
| genai_extract_tool_calls | Extracts tool calls from messages |
| genai_extract_user_prompt | Extracts the user prompt from a conversation |
| genai_get_content_by_index | Gets message content by index position |
| genai_get_content_by_role | Gets message content by role |
| genai_get_pricing | Gets pricing information for a specific model |
| genai_get_role | Gets the role of a message at a specific index |
| genai_has_tool_calls | Checks if messages contain tool calls |
| genai_input_cost | Calculates the cost for input tokens |
| genai_is_truncated | Checks if a response was truncated |
| genai_message_roles | Extracts all message roles from a conversation |
| genai_output_cost | Calculates the cost for output tokens |