Skip to content
🦑 TruLens
trulens.benchmark.generate
Initializing search
truera/trulens
🏠 Home
🚀 Getting Started
🗺️ Component Guides
📚 API Reference
🧑🍳 Cookbook
🤝 Contributing
✍️ Blog
🦑 TruLens
truera/trulens
🏠 Home
🚀 Getting Started
🚀 Getting Started
📓 Quickstarts
📓 Quickstarts
📓 TruLens Quickstart
📓 Add Dataframe Quickstart
📓 TruLens with Outside Logs
📓 LangChain Quickstart
📓 LlamaIndex Quickstart
📓 Text to Text Quickstart
📓 Ground Truth Evaluations
📓 Logging Human Feedback
📓 Groundtruth Evaluations for Retrieval Systems
📓 Persist Groundtruth Datasets
📓 Evaluate Streaming Apps
⭐ Core Concepts
⭐ Core Concepts
☔ Feedback Functions
⟁ RAG Triad
🏆 Honest, Harmless, Helpful Evals
🎈Viewing Results
🎈Viewing Results
🗺️ Component Guides
🗺️ Component Guides
Instrumentation
Instrumentation
🦜️🔗 LangChain Integration
🦙 LlamaIndex Integration
NeMo Guardrails Integration
Logging
Logging
❄️ Logging in Snowflake
Logging Methods
🎯 Evaluation
🎯 Evaluation
Anatomy of a Feedback Function
Feedback Implementations
Feedback Implementations
Stock Feedback Functions
📓 Custom Feedback Functions
Feedback Selectors
Feedback Selectors
Selecting Components
Selector Shortcuts
Feedback Aggregation
Feedback Aggregation
Feedback Aggregation
Running Feedback Functions
Running Feedback Functions
Running with your app
Running on existing data
Generating Test Cases
Generating Test Cases
Generating Test Cases
📊 Evaluation Benchmarks
📊 Evaluation Benchmarks
📓 Answer Relevance Feedback Evaluation
📓 Comprehensiveness Evaluations
📓 Context Relevance Evaluations
📓 Context Relevance Benchmarking: ranking is all you need.
📓 Groundedness Evaluations
🛡️ Guardrails
🛡️ Guardrails
Other
Other
Moving from TruLens Eval
Uninstalling TruLens
📚 API Reference
📚 API Reference
providers
providers
📦 Snowflake Cortex
📦 Snowflake Cortex
endpoint
provider
📦 LangChain
📦 LangChain
endpoint
provider
📦 Amazon Bedrock
📦 Amazon Bedrock
endpoint
provider
📦 HuggingFace
📦 HuggingFace
endpoint
provider
📦 LiteLLM
📦 LiteLLM
endpoint
provider
📦 OpenAI
📦 OpenAI
endpoint
provider
apps
apps
basic
custom
virtual
📦 LlamaIndex
📦 LlamaIndex
guardrails
llama
tru_llama
📦 LangChain
📦 LangChain
guardrails
langchain
tru_chain
📦 Nemo Guardrails
📦 Nemo Guardrails
tru_rails
connectors
connectors
📦 Snowflake
📦 Snowflake
connector
utils
utils
server_side_evaluation_artifacts
server_side_evaluation_stored_procedure
sis_dashboard_artifacts
❌ trulens_eval
core
core
app
database
database
base
connector
connector
base
default
exceptions
legacy
legacy
migration
migrations
migrations
data
env
orm
sqlalchemy
utils
experimental
feedback
feedback
endpoint
feedback
provider
guardrails
guardrails
base
instruments
schema
schema
app
base
dataset
feedback
groundtruth
record
select
types
session
utils
utils
asynchro
constants
containers
deprecation
imports
json
keys
pace
pyschema
python
serial
text
threading
trulens
feedback
feedback
dummy
dummy
endpoint
provider
embeddings
feedback
generated
groundtruth
llm_provider
prompts
v2
v2
feedback
provider
provider
base
dashboard
dashboard
Leaderboard
appui
components
components
record_viewer
constants
display
pages
pages
Compare
Records
run
streamlit
utils
utils
dashboard_utils
metadata_utils
notebook_utils
records_utils
sis_utils
streamlit_compat
ux
ux
components
styles
benchmark
benchmark
benchmark_frameworks
benchmark_frameworks
tru_benchmark_experiment
generate
generate
generate_test_set
test_cases
🧑🍳 Cookbook
🧑🍳 Cookbook
Frameworks
Frameworks
Canopy
Canopy
TruLens-Canopy Quickstart
Cortexchat
Cortexchat
Cortex Chat + TruLens
Langchain
Langchain
LangChain Agents
LangChain Async
LangChain Ensemble Retriever
Ground Truth Evaluations
LangChain Math Agent
Langchain model comparison
LangChain retrieval agent
LangChain Stream
Langchain summarize
Llama index
Llama index
Llama index agents
LlamaIndex Async
Advanced Evaluation Methods
GroundTruth evaluation for LlamaIndex applications
LlamaIndex Hybrid Retriever + Reranking + Guardrails
Evaluating Multi-Modal RAG
Query Planning in LlamaIndex
Measuring Retrieval Quality
LlamaIndex Stream
Nemoguardrails
Nemoguardrails
Feedback functions in NeMo Guardrails apps
Monitoring and Evaluating NeMo Guardrails apps
Openai assistants
Openai assistants
OpenAI Assistants API
Models
Models
Anthropic
Anthropic
Anthropic Quickstart
Claude 3 Quickstart
Azure
Azure
Azure OpenAI LangChain Quickstart
Azure OpenAI Llama Index Quickstart
Bedrock
Bedrock
AWS Bedrock
Deploy, Fine-tune Foundation Models with AWS Sagemaker, Iterate and Monitor with TruEra
Google
Google
Multi-modal LLMs and Multimodal RAG with Gemini
Google Vertex
local and OSS models
local and OSS models
Vectara HHEM Evaluator Quickstart
LiteLLM Quickstart
Local vs Remote Huggingface Feedback Functions
Ollama Quickstart
Snowflake cortex
Snowflake cortex
❄️ Snowflake Arctic Quickstart with Cortex LLM Functions
Cortex Finetuning Experiments
Use cases
Use cases
📓 Context Filters
Language Verification
Model Comparison
Moderation
PII Detection
❄️ Snowflake with Key-Pair Authentication
Evaluating Summarization with TruLens
Iterate on rag
Iterate on rag
Iterating on LLM Apps with TruLens
Iterating on LLM Apps with TruLens
Iterating on LLM Apps with TruLens
Iterating on LLM Apps with TruLens
Iterating on LLM Apps with TruLens
Vector stores
Vector stores
Faiss
Faiss
LangChain with FAISS Vector DB
Milvus
Milvus
Iterating with RAG on Milvus
Milvus
Mongodb
Mongodb
Atlas quickstart
Pinecone
Pinecone
Pinecone Configuration Choices on Downstream App Performance
Simple Pinecone setup with LlamaIndex + Eval
🤝 Contributing
🤝 Contributing
🧭 Design
📦 Release Policies
✅ Standards
💣 Tech Debt
⛅ Optional Packages
✨ Database Migration
🏁 Release History
✍️ Blog
✍️ Blog
Archive
Archive
2024
Categories
Categories
General
Table of contents
generate
trulens.benchmark.generate
¶
trulens.benchmark.generate
¶
Back to top