Programming

11 posts

·9 min·Programming

Sabattier: A Batch Photo Editor with On-Device AI

Sabattier is a batch photo editor for Windows and macOS. It has auto enhance, masks, portrait retouching, background removal and AI upscaling. All of these run on your computer.

·3 min·Deep RL with Unity 3/3

DDPG on Reacher: Twenty Arms Chasing a Balloon

DDPG completes the Unity Reacher task. Twenty robot arms use one shared replay buffer. This post shows the actor-critic setup and why the training was easier than Tennis.

·3 min·Deep RL with Unity 2/3

Two DDPG Agents Learning to Play Tennis

Two DDPG agents learn to play tennis in the Unity Tennis environment. This post shows the continuous actions, the shared sparse rewards, the methods that did not work and the settings that completed the task.

·2 min·Deep RL with Unity 1/3

Training a DQN Agent to Collect Bananas in Unity

A DQN agent learns to collect bananas in the Unity Banana Collector environment. This post shows the Q-network, the replay buffer, the target network settings and the result (+13 over 100 episodes).

·1 min·LAPACK on macOS 1/2

How to Install LAPACK on Mac OS

LAPACK already ships with macOS in Apple's Accelerate framework. If you want the latest version instead, here is how to install it with Homebrew.