Tech Blog

[Tech Blog] BigQuery View Table for Machine Learning Feature Store

Hi, I’m Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

At AnyMind, we are developing our MLOps environment from scratch and in a previous article, we introduced the machine learning batch prediction architecture using Vertex AI.

In this article, as a continuation of our previous article on data infrastructure for machine learning, we hope to introduce the data infrastructure for machine learning that we are currently using.

Background

Cloud Composer (Airflow) for Machine Learning Data Pipeline

As noted in this article, the mod

Tech Blog

AnyMind Group

Jul 26, 2022

[Tech Blog] Machine Learning Batch Prediction Architecture Using Vertex AI

Hi, I’m Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

At AnyMind, we are developing our MLOps environment and in a previous article, I introduced the architecture used during the initial phase of our machine learning implementation. In this article, I would like to introduce our current batch prediction architecture implemented with Vertex AI as a sequel.

Previous Architecture

As described in this article, in the previous architecture, the product application fetched features from its RDB and requests them to a predict API. In

Tech Blog

AnyMind Group

Jul 15, 2022

[Tech Blog] Online Inference Using Vertex AI Models / Endpoints on Early Phase of Machine learning Introduction

Hi, I'm Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

In AnyMind, we are developing our MLOps environment from scratch.

In previous articles, we have introduced our efforts to create an MLOps environment such as data pipeline and model training pipeline.

This time, we would like to introduce our online prediction infrastructure using Vertex Pipelines (Kubeflow) and Vertex AI Models / Endpoints, which we have been taking during the early phase of machine learning introduction.

Background

As mentioned in the article about the m

Tech Blog

AnyMind Group

Jul 14, 2022

[Tech Blog] AnyCreator’s Link-in-bio analytics with Google Analytics and BigQuery

AnyCreator has recently released a new feature called Link-in-bio which allows influencers and content creators to create and customize their micro website, and use this page as their content hub across social media platforms.

Included in this feature is a Link-in-bio analytics dashboard that tracks the user's bio page traffic including all clicks, page views, and overall page growth.

Before we proceed, allow me to introduce myself. I am Adean, a back-end developer from the AnyCreator team, and in this article, I will give you an overview of how we man

Tech Blog

AnyMind Group

Jul 13, 2022

[Tech Blog] Vertex Pipelines (Kubeflow) for Machine Learning Model Training Pipeline

Hi, I'm Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

In AnyMind, we are developing our MLOps environment, including the model training pipeline from scratch.

In previous article, I introduced our data pipeline using Cloud Composer (Airflow) including its current set up and future plans.

In this article, I'd like to introduce our ML model training pipeline using Vertex Pipelines (Kubeflow).

Background / Problems

Firstly, let me explain about background and problems before introducing Vertex Pipelines (Kubeflow).

Individualiz

Tech Blog

AnyMind Group

Jun 21, 2022

[Tech Blog] Cloud Composer (Airflow) for Machine Learning Data Pipeline

Hi, I'm Naoki Komoto (河本直起) working as Machine Learning Engineer in AnyMind.

In AnyMind, we are developing our MLOps environment, including the data pipeline from scratch.

In this article, I'd like to introduce our data pipeline using Cloud Composer (Airflow) including its current set up and future plans.

Problems

The dataset for the machine learning (ML) model training is originally stored in the product application’s RDB. When I joined the team, model training application directly fetches dataset from the RDB.

As RDB is chosen due to its suitabil

Oct 20, 2021

Tech Blog

[Tech Blog] BigQuery View Table for Machine Learning Feature Store

[Tech Blog] Machine Learning Batch Prediction Architecture Using Vertex AI

[Tech Blog] Online Inference Using Vertex AI Models / Endpoints on Early Phase of Machine learning Introduction

[Tech Blog] AnyCreator’s Link-in-bio analytics with Google Analytics and BigQuery

[Tech Blog] Vertex Pipelines (Kubeflow) for Machine Learning Model Training Pipeline

[Tech Blog] Cloud Composer (Airflow) for Machine Learning Data Pipeline

[Tech Blog] Machine Learning Batch Prediction Architecture Using Vertex AI

[Tech Blog] Online Inference Using Vertex AI Models / Endpoints on Early Phase of Machine learning Introduction

[Tech Blog] AnyCreator’s Link-in-bio analytics with Google Analytics and BigQuery

[Tech Blog] Vertex Pipelines (Kubeflow) for Machine Learning Model Training Pipeline

[Tech Blog] Cloud Composer (Airflow) for Machine Learning Data Pipeline

[Tech Blog] Improving the search for influencers using Elasticsearch in AnyTag

[Tech Blog] AnyChat Backend powered by Scala, Akka

[Tech Blog] How we built AnyChat’s Front-End

[Tech Blog] Story Engine development and future prospects

[Tech Blog] Betting On Headless E-Commerce

[Tech Blog] Create NPM Package by Typescript

[Tech Blog] Scrapy with Django Integration

Join Us

Career

Contact Us