The case for unit-normalized loss (with back-propagation) Imagine you're me - struggling to debug unstable training[1] - then while taking a detour[2] into optimizers you find out that not only does batch accumulation affect the step-size (effective learning-rate), the scalar loss value you end up with also scales the gradients. I had assumed
Technical Virtualizing my old desktop with QEMU In the process I made a disk image of my OS, in case I needed some data I forgot to back up. Now I could have restored the disk image, booted into it, and then back it up. But then I got an idea, what if I just boot into it with QEMU.
Projects Distributed Evolutionary Strategies It's a framework based on a paper by OpenAI, however at this point we have far increased the functionality described in the paper. We also have a roadmap for other features which are planned to be implemented, such as ESAC.
Projects Produce research - Subscriptions A small research created on how Invoice Manager is usable for reoccurring billing situations aka subscriptions. Here I explain how it currently is done, what an optimal solution would be and a proposed solution sketch. With subscriptions, I am referring to the reoccurring invoices for our contacts. E.g: hosting,
Diving into Evolutionary Strategies In a recent project I've had the chance to work with 'self-learning agents'. While an easy way to go is to just take a common A3C library and use that, I wanted to explore evolutionary strategies (ES). They piqued my interest because of simplicity, and the
Projects Invoice Manager - The return of Earlier last year, I had spoken about the way we manage our invoices with our amazing invoice generator. With it's increased popularity on google it's ready for an update. Now get ready for its long-awaited, by me, successor. *drum rumble*. Invoice Manager 🎉! A better, faster and
Yet another guide to Neural Networks This is a theoretical introduction to Neural Networks. This introduction is meant to help gain intuition and help out with common issues. Not to get you going with any framework in particular. [Disclaimer of problem classification] The fundamental theory Neural networks are but transformations Recommended: You can create and test
Technical Generalized 'parallel' popcnt For a recent project I was looking to use Bloom filters to verify a efficient serialized structures (receiver can verify if they have the correct arbitrary deserialization). Now popcnt is a quite common function; it's available on many architectures as a single instruction. It counts the amount of
Casual/Personal Analysing 'Choose your own adventure' books A recent interest of mine has become analysing Choose your own adventure books. I've never read the original choose your own adventure books, but got introduced to it because of an upcoming project. There are quite a few interesting things to observe in these books without even going
Technical Real-time natural TTS Deep Learning TTS has been a hot subject for several years now, and while the results are impressive, most of these models are way to slow to use in production. In this article we are going to explore an end-to-end solution for TTS for near real-time, and possibly even mobile,
Devdroplets ♥ Traefik Have you ever wondered: "how many servers it takes to deploy a lightbulb?" Of course not, that would be quite strange. However, we have. If the lightbulb was a web service and then deploying it to the worldwide web. More precisely, how do we provide the services as
Projects Featured Invoice manager If you've ever seen our any of our invoices you'll notice that they all look the same, this is because of the fact that we have our own invoice generator program that does the administration management for us. From out this program we create, view and
Electronics Stereo Audio Combiner For years I've been looking for a solution to real-time audio combining. Trying to combine the music from my phone and the content from my desktop into the same speakers. Originally I tried it with free software, running a line into my desktop from my phone, and playing
Electronics Call-to-Mail Forwarding This project aims to redirect an incoming phone call to an e-mail address, without any third-party services, the entire system running locally. Essentially telling the person what they need to do to contact you by other means. A similar thing can be done using phones when it goes over to
