ShaofanLai's Blog

Fight on!

Spotlights

A practice for Apache families (Hadoop / HDFS / Yarn / Spark / Kafka / Zookeeper/Flink)

2018

20

Oct

Recently I have been frequently using the data processing frameworks from Apache (Hadoop/HDFS/Yarn/Spark/Kafka/ZooKeeper). And I designed a comprehensive project that uses all of them in one project and the purpose is to analyze the crime distribution in LA. I would like to have a brief summary here and move on to other techs.   I think the most fundamental and earliest framework is Hadoop. Hadoop... 5049

Engineering Spotlight

Most Views

How to implement GAN with Keras

This tutorial is to guide you how to implement GAN with Keras. The complete code can be access in my github repository. If you are not familiar with GAN, please check the first part of this post or an... 22966

Implement improved WGAN with Keras-2.x

This tutorial is based on Improved Training of Wasserstein GANs (IWGAN). You can learn how to customized layers and how to build IWGAN with Keras. The code can be accessed in my github repository. Not... 16227

Survey: Deep learning with Self-Organizing Map

Self-Organizing Map is one of my favorite bionics models. In most cases, it is applied to visualize data with high dimension, and indeed it can generate pretty amazing results: SOM is also closely rel... 13268

Using Myo to control Raspberry Pi

This is the first project I did with Raspberry Pi. Here is a very simple demo: It is a quite simple project where I can use my dusty Myo. The most difficult part is to enable Raspberry Pi to communica... 8639

Notes About GAN

Introduction The last time I wrote notes was last April (on my old blog).  I spend last summer holiday preparing for application and focused on attention models. Suggested by my tutor, I have started ... 8600

From MLE/MAP to L2-Loss Regression

Today we are going to derive the objective of regression from Maximum likelihood estimation (MLE) and Maximum a posteriori estimation(MAP). We are going to prove that, given certain assumptions, optim... 7535

Recent Posts

Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials

It’s 2020 now! I am going to pick up paper reading just for fun (better than playing video games and watching TV all night lol)! This is a paper from 2012 and my friend recommended it to me. It’s a gr... 2810

Dancing Lights with Raspberry PI

  It has been a long time since last time I posted a blog. I recently joined Google and work on Google Analytics. Feel welcome to send me a resume if you are interested in joining us or joining Alphab... 3079

Host your own broadcast

Recently I want to host my own broadcast on-air. After some digging, I found this repository is a very useful tool for the beginners. Here are some notes that I want to keep: RTMP (Adobe Real-Time Mes... 3602

An Update Log System

For the recent few months, I realized that I wrote in the “Exp” (experiment) section more than writing in the post section. Therefore, it’s hard to track my updating from the homepage. Since the Exp s... 3184

How to SSH to a Remote Server without Public IP (FREE)

When I arrived USC, I decided to spend my money on a desktop (for scientific computation) rather than a Mac. And it turns out to be very useful and I got 800$ reward from Deep Learning class because o... 6665

A practice for Apache families (Hadoop / HDFS / Yarn / Spark / Kafka / Zookeeper/Flink)

Recently I have been frequently using the data processing frameworks from Apache (Hadoop/HDFS/Yarn/Spark/Kafka/ZooKeeper). And I designed a comprehensive project that uses all of them in one project a... 5049

Bulletin

The steps you take don't need to be big; they just need to take you in the right direction

My Github name has been changed to `Shaofanl`! Goodbye `piscesdream` and fight on! 

 

Ready to build something cool at Google!!!

Feel free to discuss anything related to the posts. If you successfully implement some of my ideas, please notify me. It is not obligated, but it can help me further extending those ideas.