Skip to main content

5 posts tagged with "docker"

View All Tags

Use Local LLMs with Oracle AI Vector Search

· 7 min read
Adrian Png
Director of Innovation, AI and Cloud Solutions @ Insum, a Talan Company

Oracle Database 23ai and Ollama logos together.

There a few reasons why we would want to perform "generative AI" tasks, such as generating embeddings, summary, and text, using local resources, rather than relying on external, third-party providers. Perhaps the most important ones are data privacy, costs, and the convenience of choosing what large language models (LLMs) to use. About four months ago, I wrote that with the Oracle Database 23ai 23.5.0.24.06 release on the Oracle Autonomous Database (ADB), it was possible to create the credentials to access these third-party LLMs through their REST APIs. Fast-forward, my ADB now has the upgraded version 23.6.0.24.10 that has support for "local" third-party REST providers, specifically, Ollama. In this article, I will demonstrate how you can utilise other Oracle Cloud Infrastructure (OCI) managed resources to quickly get started.

ARM Your APEX Instance

· 8 min read
Adrian Png
Director of Innovation, AI and Cloud Solutions @ Insum, a Talan Company

Embedded ARM chip

In September 2020, Oracle first announced that it was working with Ampere Computing to provide ARM-based chips for its Compute instance offering on the Oracle Cloud Infrastructure. They have delivered!

ARM chips are found in many low-powered devices like smartphones, single-board computers, and IoT devices. So, if you are an Oracle Application Express (APEX) developer, you might be wondering, "What's in it for me?" Well, remember we talked about running a customer-managed Oracle REST Data Services (ORDS) instance for an Oracle Autonomous Database?

Remote Coding with Visual Studio Code

· 2 min read
Adrian Png
Director of Innovation, AI and Cloud Solutions @ Insum, a Talan Company

Colouring Pens and Remote

Support for remote development is one of the newer features of Microsoft Visual Studio Code (VS Code) announced in 2019 that I'm most excited about. With the Remote Development Extension Pack, developers are able to work with code on remote servers using SSH, Docker containers and Windows Subsystem for Linux (WSL).

Helper Scripts - Build an APEX Stack

· 2 min read
Adrian Png
Director of Innovation, AI and Cloud Solutions @ Insum, a Talan Company

Photo by Markus Distelrath

When Oracle Database 18c Express Edition (18cXE) was released late last year, I was motivated to work on an image for running the newly released, FREE database using Docker. The scripts were based on the official Docker images published by Oracle. With much help from Martin D'Souza, we released the scripts to the community with pointers on how to install and run an Oracle Application Express (APEX) stack.

Snap in Storage For Your Docker Playground

· 4 min read
Adrian Png
Director of Innovation, AI and Cloud Solutions @ Insum, a Talan Company

Floppy Disks

ICYMI (in case you missed it), a team from Oracle has been hard at work these few months churning out a bunch of Vagrant configuration files and scripts that help you provision some really cool virtual machines (VM), powered by Oracle Enterprise Linux. At the time of writing, here are some of the cool VMs you can build: