Skip to content

🦑 TruLens

inline_evaluations

Initializing search

🏠 Home
🚀 Getting Started
🗺️ Component Guides
📚 API Reference
🧑‍🍳 Cookbook
🔭 OpenTelemetry
🤝 Contributing
✍️ Blog

🦑 TruLens

🏠 Home
🚀 Getting Started
🚀 Getting Started
- 📓 Quickstarts
  📓 Quickstarts
- ⭐ Core Concepts
  ⭐ Core Concepts
- 🎈Viewing Results
  🎈Viewing Results
🗺️ Component Guides
🗺️ Component Guides
- Instrumentation
  Instrumentation
  - 🦜️🔗 LangChain Integration
  - 🦙 LlamaIndex Integration
- Logging
  Logging
  - ❄️ Logging in Snowflake
  - Logging Methods
- 🎯 Evaluation
  🎯 Evaluation
  - Anatomy of a Feedback Function
  - Feedback Implementations
    
    Feedback Implementations
    
    Stock Feedback Functions
    
    📓 Custom Feedback Functions
  - Feedback Selectors
    
    Feedback Selectors
    
    Selecting Components
    
    Selector Shortcuts
  - Feedback Aggregation
    Feedback Aggregation
    
    Feedback Aggregation
  - Running Feedback Functions
    Running Feedback Functions
    
    Running with your app
    
    Running on existing data
  - Generating Test Cases
    Generating Test Cases
    
    Generating Test Cases
- 🏃 Runtime Evaluation
  🏃 Runtime Evaluation
  - In-line Evaluations
  - Guardrails
- Other
  Other
  - Moving from TruLens Eval
  - Uninstalling TruLens
📚 API Reference
📚 API Reference
- providers
  providers
  - 📦 Snowflake Cortex
    
    📦 Snowflake Cortex
    
    endpoint
    
    provider
  - 📦 LangChain
    
    📦 LangChain
    
    endpoint
    
    provider
  - 📦 Amazon Bedrock
    
    📦 Amazon Bedrock
    
    endpoint
    
    provider
  - 📦 HuggingFace
    
    📦 HuggingFace
    
    endpoint
    
    provider
  - 📦 LiteLLM
    
    📦 LiteLLM
    
    endpoint
    
    provider
  - 📦 OpenAI
    
    📦 OpenAI
    
    endpoint
    
    provider
- apps
  apps
  - basic
  - custom
  - virtual
  - 📦 LlamaIndex
    
    📦 LlamaIndex
    
    guardrails
    
    llama
    
    tru_llama
  - langgraph
    
    langgraph
    
    inline_evaluations inline_evaluations
    Table of contents
    
    inline_evaluations
    
    Classes
    
    inline_evaluation
    
    tru_graph
  - 📦 LangChain
    
    📦 LangChain
    
    guardrails
    
    langchain
    
    tru_chain
  - 📦 NeMo Guardrails
    
    📦 NeMo Guardrails
    
    tru_rails
- connectors
  connectors
  - 📦 Snowflake
    
    📦 Snowflake
    
    connector
    
    otel_exporter
    
    utils
    
    utils
    
    server_side_evaluation_artifacts
    
    server_side_evaluation_stored_procedure
    
    sis_dashboard_artifacts
- ❌ trulens_eval
- core
  core
  - app
  - database
    
    database
    
    base
    
    connector
    
    connector
    
    base
    
    default
    
    exceptions
    
    legacy
    
    legacy
    
    migration
    
    migrations
    
    migrations
    
    data
    
    env
    
    orm
    
    sqlalchemy
    
    utils
  - experimental
  - feedback
    
    feedback
    
    endpoint
    
    feedback
    
    feedback_function_input
    
    provider
    
    selector
  - guardrails
    
    guardrails
    
    base
  - instruments
  - run
  - schema
    
    schema
    
    app
    
    base
    
    dataset
    
    event
    
    feedback
    
    groundtruth
    
    record
    
    select
    
    types
  - session
  - utils
    
    utils
    
    asynchro
    
    constants
    
    containers
    
    deprecation
    
    evaluator
    
    imports
    
    json
    
    keys
    
    pace
    
    pyschema
    
    python
    
    serial
    
    signature
    
    text
    
    threading
    
    trulens
- feedback
  feedback
  - computer
  - dummy
    
    dummy
    
    endpoint
    
    provider
  - embeddings
  - feedback
  - generated
  - groundtruth
  - llm_provider
  - output_schemas
  - prompts
  - v2
    
    v2
    
    feedback
    
    provider
    
    provider
    
    base
- dashboard
  dashboard
  - Leaderboard
  - appui
  - components
    
    components
    
    record_viewer
    
    record_viewer_otel
  - constants
  - display
  - pages
    
    pages
    
    Compare
    
    Records
  - run
  - streamlit
  - utils
    
    utils
    
    dashboard_utils
    
    metadata_utils
    
    notebook_utils
    
    records_utils
    
    sis_utils
    
    streamlit_compat
  - ux
    
    ux
    
    components
    
    styles
- benchmark
  benchmark
  - benchmark_frameworks
    
    benchmark_frameworks
    
    tru_benchmark_experiment
  - generate
    
    generate
    
    generate_test_set
  - test_cases
🧑‍🍳 Cookbook
🧑‍🍳 Cookbook
- Frameworks
  Frameworks
  - Langchain
    Langchain
    
    LangChain Ensemble Retriever
    
    LangChain Quickstart
    
    Multi-agent Data Tasks
    
    LangGraph Quickstart
    
    TruGraph Tutorial: Instrumenting LangGraph Applications with OTel
  - Llamaindex
    Llamaindex
    
    Llama index agents
    
    LlamaIndex Async
    
    GroundTruth evaluation for LlamaIndex applications
    
    LlamaIndex Hybrid Retriever + Reranking + Guardrails
    
    Evaluating Multi-Modal RAG
    
    Query Planning in LlamaIndex
    
    📓 LlamaIndex Quickstart with Otel
    
    Measuring Retrieval Quality
    
    Evaluating Sentence Window RAG
    
    LlamaIndex Stream
- Models
  Models
  - Anthropic
    Anthropic
    
    Anthropic Quickstart
    
    Claude 3 Quickstart
  - Azure
    Azure
    
    Azure OpenAI LangChain Quickstart
    
    Azure OpenAI Llama Index Quickstart
  - Bedrock
    Bedrock
    
    AWS Bedrock
    
    Deploy, Fine-tune Foundation Models with AWS Sagemaker, Iterate and Monitor with TruEra
  - Google
    Google
    
    Multi-modal LLMs and Multimodal RAG with Gemini
    
    Google Vertex
  - local and OSS models
    local and OSS models
    
    Vectara HHEM Evaluator Quickstart
    
    LiteLLM Quickstart
    
    Local vs Remote HuggingFace Feedback Functions
    
    Ollama Quickstart
  - Snowflake cortex
    Snowflake cortex
    
    Cortex Finetuning Experiments
    
    ❄️ Snowflake Quickstart with Cortex LLM Functions
- Use cases
  Use cases
  - 📓 Context Filters
  - Language Verification
  - Model Comparison
  - Moderation
  - PII Detection
  - ❄️ Snowflake with Key-Pair Authentication
  - Evaluating Summarization with TruLens
  - Debugging evaluation results with TruLens Hotspots
  - Iterate on rag
    Iterate on rag
    
    Iterating on LLM Apps with TruLens
    
    Iterating on LLM Apps with TruLens
    
    Iterating on LLM Apps with TruLens
    
    Iterating on LLM Apps with TruLens
    
    Iterating on LLM Apps with TruLens
  - Snowflake ai stack
    
    Snowflake ai stack
    
    Snowflake AI Stack: Notebook
- Vector stores
  Vector stores
  - Faiss
    
    Faiss
    
    LangChain with FAISS Vector DB
  - Milvus
    Milvus
    
    Iterating with RAG on Milvus
    
    Milvus
  - Mongodb
    Mongodb
    
    Atlas quickstart
  - Pinecone
    Pinecone
    
    Pinecone Configuration Choices on Downstream App Performance
    
    Simple Pinecone setup with LlamaIndex + Eval
  - Weaviate
    Weaviate
    
    Evaluating Weaviate Query Agents
🔭 OpenTelemetry
🔭 OpenTelemetry
- Semantic conventions
🤝 Contributing
🤝 Contributing
✍️ Blog
✍️ Blog
- Archive
  Archive
  - 2025
  - 2024
- Categories
  Categories
  - General

Table of contents

inline_evaluations
- Classes
  - inline_evaluation

trulens.apps.langgraph.inline_evaluations¶

trulens.apps.langgraph.inline_evaluations ¶

Classes¶

inline_evaluation ¶