LT

Julius Ruseckas

My photo
Baltic Institute of Advanced Technology (BPTI),
Pilies g. 16-8, LT-01403, Vilnius, Lithuania
E-mail re

Quick information

I am reseracher at the Baltic Institute of Advanced Technology (BPTI).

Previously I was research professor at the Institute of Theoretical Physics and Astronomy, Faculty of Physics, Vilnius University.

Areas of research

The current field of research is machine learning and deep learning.

Previous field of research was theoretical physics. Topics of research included quantum optics, ultracold atomic gases, modelling and theory of 1/f noise.

The code used for numerical solution of stochastic differential equations by employing a variable time step is provided in a GitHub repository.

Machine learning

Small model for CIFAR10; Jupyter notebook

EfficienNet-like model on CIFAR10; Jupyter notebook

Pre-activation ResNet; Jupyter notebook

Journal Club: Patches Are All You Need?; Jupyter notebook

Journal Club: CoAtNet: Marrying Convolution and Attention for All Data Sizes; Jupyter notebook

Journal Club: Multiscale Vision Transformers; Jupyter notebook

Journal Club: Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet; Jupyter notebook

ResNet on CIFAR10; Jupyter notebook

Update: PyTorch Lightning; Jupyter notebook

Journal Club: Perceiver: General Perception with Iterative Attention; Jupyter notebook

Transformer for MNIST-1D; Jupyter notebook

Update: Julia and Flux.jl; Jupyter notebook

Journal Club: Bottleneck Transformers for Visual Recognition; Jupyter notebook

Transformer for audio data; Jupyter notebook

Getting started with PyTorch Ignite; Jupyter notebook

Journal Club: WaveNet; Jupyter notebook

Getting started with Julia and Flux.jl; Pluto notebook

Getting started with PyTorch Lightning; Jupyter notebook

Getting started with Trax; Jupyter notebook

Journal Club: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale; Jupyter notebook

Explanation of minGPT; Jupyter notebook

Getting started with Jupyter; Jupyter notebook

PixelShuffle for image upsampling; Jupyter notebook

Neural network training tricks II; Jupyter notebook

Journal Club: Spatial Group-wise Enhance; Jupyter notebook

Neural network training tricks; Jupyter notebook

Differential equations and neural networks; PDF

Getting started with Python: NumPy and Matplotlib

Getting started with Python