Quick information
I am lapsed physicist dabbling in machine learning.
Currently I work at medical imaging company Oxipit.
I am also data science reseracher at the Baltic Institute of Advanced Technology (BPTI).
Previously I was research professor at the Institute of Theoretical Physics and Astronomy, Faculty of Physics, Vilnius University.
Book
Book about quantum computers “Kvantinė kompiuterija” (in Lithuanian), written by Tadas Paulauskas (Center for Physical Sciences and Technology, Department of Optoelectronics) and me. The online version can be accessed at www.kvantinekompiuterija.lt, sources of the book in the bookdown format are available in a GitHub repository.
Machine learning
Torchvision Transforms V2; Jupyter notebook
Feature Visualization by Optimization; Jupyter notebook
Marimo: reactive notebooks for Python
Tiny model for CIFAR10; Jupyter notebook
Small model for CIFAR10—III; Jupyter notebook
Journal Club: Symbolic Discovery of Optimization Algorithms; Jupyter notebook
Journal Club: EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applications; Jupyter notebook
Update: ConvNeXtV2; Jupyter notebook
ResNet for fast training on CIFAR10; Jupyter notebook
Simple Residual GAN; Jupyter notebook
Hierarchical VQ-VAE; Jupyter notebook
Vector Quantised VAE; Jupyter notebook
Hierarchical VAE; Jupyter notebook
Variational Autoencoder (VAE); Jupyter notebook
Quantum Machine Learning; PDF
Detection of radio signal modulation; Jupyter notebook
Simple YOLO-like object detector; Jupyter notebook
Simple object detection model; Jupyter notebook
Small model for CIFAR10—II; Jupyter notebook
Getting started with FFCV; Jupyter notebook
Simple image segmenation model; Jupyter notebook
Getting started with Objax; Jupyter notebook
Getting started with Haiku; Jupyter notebook
Getting started with Flax; Jupyter notebook
Extreme Learning Machine using PyTorch; Jupyter notebook
Journal Club: A ConvNet for the 2020s; Jupyter notebook
Revisiting vision transformer; Jupyter notebook
Journal Club: Swin Transformer: Hierarchical Vision Transformer using Shifted Windows; Jupyter notebook
Small model for CIFAR10; Jupyter notebook
EfficientNet-like model on CIFAR10; Jupyter notebook
Pre-activation ResNet; Jupyter notebook
Journal Club: Patches Are All You Need?; Jupyter notebook
Journal Club: CoAtNet: Marrying Convolution and Attention for All Data Sizes; Jupyter notebook
Journal Club: Multiscale Vision Transformers; Jupyter notebook
Journal Club: Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet; Jupyter notebook
ResNet on CIFAR10; Jupyter notebook
Update: PyTorch Lightning; Jupyter notebook
Journal Club: Perceiver: General Perception with Iterative Attention; Jupyter notebook
Transformer for MNIST-1D; Jupyter notebook
Update: Julia and Flux.jl; Jupyter notebook
Journal Club: Bottleneck Transformers for Visual Recognition; Jupyter notebook
Transformer for audio data; Jupyter notebook
Getting started with PyTorch Ignite; Jupyter notebook
Journal Club: WaveNet; Jupyter notebook
Getting started with Julia and Flux.jl; Pluto notebook
Getting started with PyTorch Lightning; Jupyter notebook
Getting started with Trax; Jupyter notebook
Journal Club: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale; Jupyter notebook
Explanation of minGPT; Jupyter notebook
Getting started with Jupyter; Jupyter notebook
PixelShuffle for image upsampling; Jupyter notebook
Neural network training tricks II; Jupyter notebook
Journal Club: Spatial Group-wise Enhance; Jupyter notebook
Neural network training tricks; Jupyter notebook
Differential equations and neural networks; PDF