Skip to content

🦑 TruLens

custom

Initializing search

🏠 Home
🚀 Getting Started
🗺️ Component Guides
📚 API Reference
🧑‍🍳 Cookbook
🤝 Contributing
✍️ Blog

🦑 TruLens

🏠 Home
🚀 Getting Started
🚀 Getting Started
- 📓 Quickstarts
  📓 Quickstarts
- ⭐ Core Concepts
  ⭐ Core Concepts
- 🎈Viewing Results
  🎈Viewing Results
🗺️ Component Guides
🗺️ Component Guides
- Instrumentation
  Instrumentation
- Logging
  Logging
  - ❄️ Logging in Snowflake
  - Logging Methods
- 🎯 Evaluation
  🎯 Evaluation
  - Anatomy of a Feedback Function
  - Feedback Implementations
    
    Feedback Implementations
    
    Stock Feedback Functions
    
    📓 Custom Feedback Functions
  - Feedback Selectors
    
    Feedback Selectors
    
    Selecting Components
    
    Selector Shortcuts
  - Feedback Aggregation
    Feedback Aggregation
    
    Feedback Aggregation
  - Running Feedback Functions
    Running Feedback Functions
    
    Running with your app
    
    Running on existing data
  - Generating Test Cases
    Generating Test Cases
    
    Generating Test Cases
- 📊 Evaluation Benchmarks
  📊 Evaluation Benchmarks
- 🛡️ Guardrails
  🛡️ Guardrails
- Other
  Other
  - Moving from TruLens Eval
  - Uninstalling TruLens
📚 API Reference
📚 API Reference
- providers
  providers
  - 📦 Snowflake Cortex
    
    📦 Snowflake Cortex
    
    endpoint
    
    provider
  - 📦 LangChain
    
    📦 LangChain
    
    endpoint
    
    provider
  - 📦 Amazon Bedrock
    
    📦 Amazon Bedrock
    
    endpoint
    
    provider
  - 📦 HuggingFace
    
    📦 HuggingFace
    
    endpoint
    
    provider
  - 📦 LiteLLM
    
    📦 LiteLLM
    
    endpoint
    
    provider
  - 📦 OpenAI
    
    📦 OpenAI
    
    endpoint
    
    provider
- apps
  apps
  - basic
  - custom custom
    Table of contents
    
    custom
    
    Classes
  - virtual
  - 📦 LlamaIndex
    
    📦 LlamaIndex
    
    guardrails
    
    llama
    
    tru_llama
  - 📦 LangChain
    
    📦 LangChain
    
    guardrails
    
    langchain
    
    tru_chain
  - 📦 Nemo Guardrails
    
    📦 Nemo Guardrails
    
    tru_rails
- connectors
  connectors
  - 📦 Snowflake
    
    📦 Snowflake
    
    connector
    
    otel_exporter
    
    utils
    
    utils
    
    server_side_evaluation_artifacts
    
    server_side_evaluation_stored_procedure
    
    sis_dashboard_artifacts
- ❌ trulens_eval
- core
  core
  - app
  - database
    
    database
    
    base
    
    connector
    
    connector
    
    base
    
    default
    
    exceptions
    
    legacy
    
    legacy
    
    migration
    
    migrations
    
    migrations
    
    data
    
    env
    
    orm
    
    sqlalchemy
    
    utils
  - experimental
  - feedback
    
    feedback
    
    endpoint
    
    feedback
    
    provider
  - guardrails
    
    guardrails
    
    base
  - instruments
  - run
  - schema
    
    schema
    
    app
    
    base
    
    dataset
    
    event
    
    feedback
    
    groundtruth
    
    record
    
    select
    
    types
  - session
  - utils
    
    utils
    
    asynchro
    
    constants
    
    containers
    
    deprecation
    
    imports
    
    json
    
    keys
    
    pace
    
    pyschema
    
    python
    
    serial
    
    signature
    
    text
    
    threading
    
    trulens
- feedback
  feedback
  - computer
  - dummy
    
    dummy
    
    endpoint
    
    provider
  - embeddings
  - feedback
  - generated
  - groundtruth
  - llm_provider
  - prompts
  - v2
    
    v2
    
    feedback
    
    provider
    
    provider
    
    base
- dashboard
  dashboard
  - Leaderboard
  - appui
  - components
    
    components
    
    record_viewer
  - constants
  - display
  - pages
    
    pages
    
    Compare
    
    Records
  - run
  - streamlit
  - utils
    
    utils
    
    dashboard_utils
    
    metadata_utils
    
    notebook_utils
    
    records_utils
    
    sis_utils
    
    streamlit_compat
  - ux
    
    ux
    
    components
    
    styles
- benchmark
  benchmark
  - benchmark_frameworks
    
    benchmark_frameworks
    
    tru_benchmark_experiment
  - generate
    
    generate
    
    generate_test_set
  - test_cases
🧑‍🍳 Cookbook
🧑‍🍳 Cookbook
- Frameworks
  Frameworks
  - Canopy
    Canopy
    
    TruLens-Canopy Quickstart
  - Cortexchat
    Cortexchat
    
    Cortex Chat + TruLens
  - Crewai
    Crewai
    
    Surprise trip
    
    Surprise trip
    
    Src
    Src
    
    Surprise travel
    Surprise travel
    
    Notebook
  - Langchain
    Langchain
    
    LangChain Agents
    
    LangChain Async
    
    LangChain Ensemble Retriever
    
    Ground Truth Evaluations
    
    LangChain Math Agent
    
    Langchain model comparison
    
    LangChain retrieval agent
    
    LangChain Stream
    
    Langchain summarize
  - Llama index
    Llama index
    
    Llama index agents
    
    LlamaIndex Async
    
    Advanced Evaluation Methods
    
    GroundTruth evaluation for LlamaIndex applications
    
    LlamaIndex Hybrid Retriever + Reranking + Guardrails
    
    Evaluating Multi-Modal RAG
    
    Query Planning in LlamaIndex
    
    Measuring Retrieval Quality
    
    LlamaIndex Stream
  - Nemoguardrails
    Nemoguardrails
    
    Feedback functions in NeMo Guardrails apps
    
    Monitoring and Evaluating NeMo Guardrails apps
  - Openai assistants
    Openai assistants
    
    OpenAI Assistants API
- Models
  Models
  - Anthropic
    Anthropic
    
    Anthropic Quickstart
    
    Claude 3 Quickstart
  - Azure
    Azure
    
    Azure OpenAI LangChain Quickstart
    
    Azure OpenAI Llama Index Quickstart
  - Bedrock
    Bedrock
    
    AWS Bedrock
    
    Deploy, Fine-tune Foundation Models with AWS Sagemaker, Iterate and Monitor with TruEra
  - Google
    Google
    
    Multi-modal LLMs and Multimodal RAG with Gemini
    
    Google Vertex
  - local and OSS models
    local and OSS models
    
    Vectara HHEM Evaluator Quickstart
    
    LiteLLM Quickstart
    
    Local vs Remote Huggingface Feedback Functions
    
    Ollama Quickstart
  - Snowflake cortex
    Snowflake cortex
    
    Cortex Finetuning Experiments
    
    ❄️ Snowflake Quickstart with Cortex LLM Functions
- Use cases
  Use cases
- Vector stores
  Vector stores
  - Faiss
    
    Faiss
    
    LangChain with FAISS Vector DB
  - Milvus
    Milvus
    
    Iterating with RAG on Milvus
    
    Milvus
  - Mongodb
    Mongodb
    
    Atlas quickstart
  - Pinecone
    Pinecone
    
    Pinecone Configuration Choices on Downstream App Performance
    
    Simple Pinecone setup with LlamaIndex + Eval
🤝 Contributing
🤝 Contributing
✍️ Blog
✍️ Blog
- Archive
  Archive
  - 2024
- Categories
  Categories
  - General

Table of contents

custom
- Classes

trulens.apps.custom¶

trulens.apps.custom ¶

Soon to be deprecated in favor of [TruApp][trulens.apps.app.TruApp].

Classes¶