Pilies g. 16-8, LT-01403, Vilnius, Lithuania

I am reseracher at the Baltic Institute of Advanced Technology (BPTI).

Previously I was research professor at the Institute of Theoretical Physics and Astronomy, Faculty of Physics, Vilnius University.

The current field of research is machine learning and deep learning.

Previous field of research was theoretical physics. Topics of research included quantum optics, ultracold atomic gases,
modelling and theory of *1/f* noise.

The code used for numerical solution of stochastic differential equations by employing a variable time step is provided in a GitHub repository.

*Simple object detection model*;
Jupyter notebook

*Small model for CIFAR10—II*;
Jupyter notebook

*Getting started with FFCV*;
Jupyter notebook

*Simple image segmenation model*;
Jupyter notebook

*Getting started with Objax*;
Jupyter notebook

*Getting started with Haiku*;
Jupyter notebook

*Getting started with Flax*;
Jupyter notebook

*Extreme Learning Machine using PyTorch*;
Jupyter notebook

*Journal Club: A ConvNet for the 2020s*;
Jupyter notebook

*Revisiting vision transformer*;
Jupyter notebook

*Journal Club: Swin Transformer: Hierarchical Vision Transformer using Shifted Windows*;
Jupyter notebook

*Small model for CIFAR10*;
Jupyter notebook

*EfficienNet-like model on CIFAR10*;
Jupyter notebook

*Pre-activation ResNet*;
Jupyter notebook

*Journal Club: Patches Are All You Need?*;
Jupyter notebook

*Journal Club: CoAtNet: Marrying Convolution and Attention for All Data Sizes*;
Jupyter notebook

*Journal Club: Multiscale Vision Transformers*;
Jupyter notebook

*Journal Club: Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet*;
Jupyter notebook

*ResNet on CIFAR10*;
Jupyter notebook

*Update: PyTorch Lightning*;
Jupyter notebook

*Journal Club: Perceiver: General Perception with Iterative Attention*;
Jupyter notebook

*Transformer for MNIST-1D*;
Jupyter notebook

*Update: Julia and Flux.jl*;
Jupyter notebook

*Journal Club: Bottleneck Transformers for Visual Recognition*;
Jupyter notebook

*Transformer for audio data*;
Jupyter notebook

*Getting started with PyTorch Ignite*;
Jupyter notebook

*Journal Club: WaveNet*;
Jupyter notebook

*Getting started with Julia and Flux.jl*;
Pluto notebook

*Getting started with PyTorch Lightning*;
Jupyter notebook

*Getting started with Trax*;
Jupyter notebook

*Journal Club: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale*;
Jupyter notebook

*Explanation of minGPT*;
Jupyter notebook

*Getting started with Jupyter*;
Jupyter notebook

*PixelShuffle for image upsampling*;
Jupyter notebook

*Neural network training tricks II*;
Jupyter notebook

*Journal Club: Spatial Group-wise Enhance*;
Jupyter notebook

*Neural network training tricks*;
Jupyter notebook

*Differential equations and neural networks*;
PDF