The OpenAI Evals shell plugins allow you to use 1Password to securely authenticateDocumentation Index
Fetch the complete documentation index at: https://www.1password.dev/llms.txt
Use this file to discover all available pages before exploring further.
oaieval and oaievalset with your fingerprint, Apple Watch, or system authentication, rather than storing your credentials in plaintext.
Follow the instructions to configure your default credentials for each CLI and source the plugins.sh file, then you’ll be prompted to authenticate OpenAI Evals with biometrics.
Requirements
- Sign up for 1Password.
- Install and sign in to 1Password 8 for Mac or Linux.
- Install 1Password CLI 2.19.0 or later.
- Connect 1Password CLI with the 1Password app.
- Install OpenAI Evals.
- Bash
- Zsh
- fish
Step 1: Configure your oaieval credentials
Step 2: Configure your oaievalset credentials
Step 3: Source the plugins.sh file
Step 4: Use the CLI
Step 5: Remove imported credentials from disk
After saving your credentials in 1Password, you can remove all local copies you previously had stored on disk.
Next steps
1Password Shell Plugins support more than 60 third-party CLIs. To see a list of supported CLIs:
To choose another plugin to get started with:
To use shell plugins for seamless context switching, learn how to configure a plugin in multiple environments or with multiple accounts.
Get help
Reference
1Password authenticates with by injecting environment variables with the credentials required by the plugin commands directly from your 1Password account.
If you saved your credentials in 1Password manually rather than using op plugin to import a new item, make sure that your field names match the table below.
If the item doesn’t contain a field with the required name, you’ll be prompted to rename one of the existing fields.
| 1Password field name | Environment variable |
|---|---|
| API Key | OPENAI_API_KEY |