Tech Blog

[Tech Blog] Vertex Pipelines (Kubeflow) for Machine Learning Model Training Pipeline

Hi, I'm Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

In AnyMind, we are developing our MLOps environment, including the model training pipeline from scratch.

In previous article, I introduced our data pipeline using Cloud Composer (Airflow) including its current set up and future plans.

In this article, I'd like to introduce our ML model training pipeline using Vertex Pipelines (Kubeflow).

Background / Problems

Firstly, let me explain about background and problems before introducing Vertex Pipelines (Kubeflow).

Individualiz

Tech Blog

AnyMind Group

Feb 1, 2023

[Tech Blog] Managing Machine Learning Architecture Using Vertex AI

Hi, I’m Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

At AnyMind we are developing our MLOps environment and in a previous article, we introduced the data infrastructure for machine learning using BigQuery View Table.

In our previous article on Vertex AI's batch prediction infrastructure, we introduced the architecture using Vertex AI at the time of its introduction. Since then, we have made some improvements in the course of operation, so we would like to introduce those improvements in this article.

Current Flow of Machine Le

Tech Blog

AnyMind Group

Dec 23, 2022

[Tech Blog] BigQuery View Table for Machine Learning Feature Store

Hi, I’m Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

At AnyMind, we are developing our MLOps environment from scratch and in a previous article, we introduced the machine learning batch prediction architecture using Vertex AI.

In this article, as a continuation of our previous article on data infrastructure for machine learning, we hope to introduce the data infrastructure for machine learning that we are currently using.

Background

Cloud Composer (Airflow) for Machine Learning Data Pipeline

As noted in this article, the mod

Tech Blog

AnyMind Group

Jul 26, 2022

[Tech Blog] Machine Learning Batch Prediction Architecture Using Vertex AI

Hi, I’m Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

At AnyMind, we are developing our MLOps environment and in a previous article, I introduced the architecture used during the initial phase of our machine learning implementation. In this article, I would like to introduce our current batch prediction architecture implemented with Vertex AI as a sequel.

Previous Architecture

As described in this article, in the previous architecture, the product application fetched features from its RDB and requests them to a predict API. In

Tech Blog

AnyMind Group

Jul 15, 2022

[Tech Blog] Online Inference Using Vertex AI Models / Endpoints on Early Phase of Machine learning Introduction

Hi, I'm Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

In AnyMind, we are developing our MLOps environment from scratch.

In previous articles, we have introduced our efforts to create an MLOps environment such as data pipeline and model training pipeline.

This time, we would like to introduce our online prediction infrastructure using Vertex Pipelines (Kubeflow) and Vertex AI Models / Endpoints, which we have been taking during the early phase of machine learning introduction.

Background

As mentioned in the article about the m

Tech Blog

AnyMind Group

Jul 14, 2022

[Tech Blog] AnyCreator’s Link-in-bio analytics with Google Analytics and BigQuery

AnyCreator has recently released a new feature called Link-in-bio which allows influencers and content creators to create and customize their micro website, and use this page as their content hub across social media platforms.

Included in this feature is a Link-in-bio analytics dashboard that tracks the user's bio page traffic including all clicks, page views, and overall page growth.

Before we proceed, allow me to introduce myself. I am Adean, a back-end developer from the AnyCreator team, and in this article, I will give you an overview of how we man

Tech Blog

AnyMind Group

Jul 13, 2022