OS-Climate NLP model inference using Open Data Hub services and Operate First infrastructure
In this video, we look at how to use Open Data Hub services to create an end to end inference pipeline for a Natural language processing model. We start by motivating the problem in brief, and then move on to the technical aspects that involve setting up the environment, running the Jupyter notebooks, creating an automated pipeline, saving the results in a SQL table and finally visualizing it using a dashboard.
Useful links:
Open Data Hub: https://opendatahub.io/
OS-Climate: https://os-climate.org/
Github aicoe-osc-demo: https://github.com/os-climate/aicoe-o...
Data Science Workflow: https://github.com/aicoe-aiops/data-s...
Aicoe-aiops project template: https://github.com/aicoe-aiops/projec...
Aicoe-ci pipeline: • Create a JupyterHub image from a git repo ...
Operate First: https://www.operate-first.cloud/