Configuring a Model in Ollama

Model name in the Ollama can be configured in two ways

  • Local System (Ollama)
  • Centralized Ollama

Prerequisites

  • Install the latest version of IBM Business Developer (IBD) V10.
  • Install the latest version of Ollama.
  • Download the required build file (from Passport Advantage).

Configuring a Model on the Local System (Ollama)

  1. Ensure that Ollama is installed and running in the background.
    Note:
    To verify, check the system taskbar notification area.

  2. Download the build file from Passport Advantage.
  3. Place both the build file and the model file in the same directory.

    Example: IBD_V10\bin

  4. Open a command prompt in the folder where the files are located.
  5. Run the following command and ensure that the command runs successfully.
    ollama create GraniteModel1 -f Modelfile

    Note:
    You can replace GraniteModel1 with any model name of your choice.
  6. Run the following command and confirm that the newly created model appears in the list.
    ollama list
  7. Copy the model name and open IBD.
  8. Go to Preferences➔API Keys.
  9. Paste the model name in the Ollama Model name field.

  10. Click Apply, then Apply and Close.
  11. Run the eglcopilot.exe application and when prompted, allow access for domain networks.

  12. Verify that the server starts successfully.
    Note:
    Do not close the eglcopilot.exe application, it must run in the background.

  13. In IBD, navigate to: Windows➔Show View➔Others.
  14. Select EGL Code Accelerator and click Open.

  15. EGL Code Accelerator opens successfully.
  16. Select the Local Granite model and start interacting with the EGL Code Accelerator.

    Note:
    Chat history is stored in the location: C:\Users\<username>\EGL Code Accelerator\IBD_chats.
Note:
If you encounter issues accessing EGL Code Accelerator:
  • Close the EGL Code Accelerator tab in the IBD.

  • Repeat steps 13 through 16.

Configuring the Model Hosted in Centralized Ollama

Follow the steps below to configure a model hosted on a centralized Ollama server.

  1. Navigate to the API Keys tab in the Preferences window.
  2. In the Ollama URL and Ollama Model Name fields, enter the centralized ollama url and ollama model name as shown in the image.

  3. Click Apply and Close.
  4. The model is now successfully configured in the centralized ollama.