Development

Development Guide¶

Dev dependencies¶

Node.js¶

TruLens uses Node.js for building react components for the dashboard. Install Node.js with the following command:

See this page for instructions on installing Node.js: Node.js

Install homebrew¶

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

Install make¶

brew install make
echo 'PATH="$HOMEBREW_PREFIX/opt/make/libexec/gnubin:$PATH"' >> ~/.zshrc

Clone the repository¶

git clone git@github.com:truera/trulens.git
cd trulens

(Optional) Install PyEnv for environment management¶

Optionally install a Python runtime manager like PyEnv. This helps install and switch across multiple python versions which can be useful for local testing.

curl https://pyenv.run | bash
git clone https://github.com/pyenv/pyenv-virtualenv.git $(pyenv root)/plugins/pyenv-virtualenv
pyenv install 3.11  # python 3.11 recommended, python >= 3.9 supported
pyenv local 3.11  # set the local python version

For more information on PyEnv, see the pyenv repository.

Install Poetry¶

TruLens uses Poetry for dependency management and packaging. Install Poetry with the following command:

curl -sSL https://install.python-poetry.org | python3 -

You may need to add the Poetry binary to your PATH by adding the following line to your shell profile (e.g. ~/.bashrc, ~/.zshrc):

export PATH=$PATH:$HOME/.local/bin

Install the TruLens project¶

Install trulens into your environment by running the following command:

poetry install

This will install dependencies specified in poetry.lock, which is built from pyproject.toml.

To synchronize the exact environment specified by poetry.lock use the --sync flag. In addition to installing relevant dependencies, --sync will remove any packages not specified in poetry.lock.

poetry install --sync

These commands install the trulens package and all its dependencies in editable mode, so changes to the code are immediately reflected in the environment.

For more information on Poetry, see poetry docs.

Install pre-commit hooks¶

TruLens uses pre-commit hooks for running simple syntax and style checks before committing to the repository. Install the hooks with the following command:

pre-commit install

For more information on pre-commit, see pre-commit.com.

Helpful commands¶

Formatting¶

Runs ruff formatter to format all python and notebook files in the repository.

make format

Linting¶

Runs ruff linter to check for style issues in the codebase.

make lint

Run tests¶

# Runs tests from tests/unit with the current environment
make test-unit

Tests can also be run in two predetermined environments: required and optional. The required environment installs only the required dependencies, while optional environment installs all optional dependencies (e.g LlamaIndex, OpenAI, etc).

# Installs only required dependencies and runs unit tests
make test-unit-required

# Installs optional dependencies and runs unit tests
make test-unit-optional

To install a environment matching the dependencies required for a specific test, use the following commands:

make env-required  # installs only required dependencies

make env-optional  # installs optional dependencies

Get Coverage Report¶

Uses the pytest-cov plugin to generate a coverage report (coverage.xml & htmlcov/index.html)

make coverage

Update Poetry Locks¶

Recreates lockfiles for all packages. This runs poetry lock in the root directory and in each package.

make lock

Update package version¶

To update the version of a specific package:

# If updating version of a specific package
cd src/[path-to-package]
poetry version [major | minor | patch]

This can also be done manually by editing the pyproject.toml file in the respective directory.

Build all packages¶

Builds trulens and all packages to dist/*

make build

Upload packages to PyPI¶

To upload all packages to PyPI, run the following command with the TOKEN environment variable set to your PyPI token.

TOKEN=... make upload-all

To upload a specific package, run the following command with the TOKEN environment variable set to your PyPI token. The package name should exclude the trulens prefix.

# Uploads trulens-providers-openai
TOKEN=... make upload-trulens-providers-openai

Deploy documentation locally¶

To deploy the documentation locally, run the following command:

make docs-serve