∫ntegrabℓε ∂iﬀerentiαℓs · unorganised notes, code, and writings of random topics

Naveed et al (2023) A Comprehensive Overview of LLMs

October 25, 2023 paper

This is a survey paper of the current status of large language models. It is a nice read because it is short (37 pages only) and covered some key components needed to understand what these models are about. [more]

Self-hosted Copilot for Your VSCode

July 17, 2023 blog system

GitHub has its Copilot service that we can pay a subscription for. It is a coding assistant in your IDE, which requires a plugin on your editor and performs auto-complete for the code you typed. There are off-the-shelf language models that can generate code like GitHub’s Copilot. But the model... [more]

Conda and CUDA

July 12, 2023 blog system

If we want to run TensorFlow or PyTorch with CUDA on Linux, for example, we can install CUDA as a system library first and then install the Python package with pip (or via apt-get, in the rare case). This way, the package will find the CUDA library at system locations.... [more]

SSH as VPN

June 12, 2023 blog system

To use SSH as a VPN, the man page provided the following instructions: [more]

Wang et al (2021) Real-ESRGAN

June 10, 2023 paper

This is to extend the SR-GAN and ESR-GAN to do blind super-resolution. The problem statement is to reconstruct the high-resolution image from low resolution (a.k.a. super-resolution), but without knowing how the low resolution is derived from the original high-resolution image, i.e., blind super-resolution. [more]