Skip to content

Commit

Permalink
docs: Add round corners for images with white background
Browse files Browse the repository at this point in the history
  • Loading branch information
lRomul committed Nov 18, 2023
1 parent 155dc69 commit 3103fe8
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,12 +36,12 @@ In the following sections, we will delve deeper into each part of the architectu

### Core

The first layer of the module is the stem. It's a point-wise convolution for increasing the number of channels, followed by batch normalization.
The first layer of the module is the stem. It's a point-wise 3D convolution for increasing the number of channels, followed by batch normalization.
The rest of the core consists of inverted residual blocks [^2][^3] with a `narrow -> wide -> narrow` channel structure.

#### Techniques

Several methods were added to the inverted residual block:
Several methods were added to the inverted residual block rewritten in 3D layers:
* **Absolute Position Encoding** [^4] - summing the encoding to the input of each block allows convolutions to accumulate position information. It's quite important because of the subsequent spatial pooling after the core.
* **Factorized (2+1)D convolution** [^5] - 3D depth-wise convolution was replaced with a spatial 2D depth-wise convolution followed by a temporal 1D depth-wise convolution. There are spatial convolutions with stride two in some blocks to compress output size.
* **Shortcut Connections** - completely parameter-free residual shortcuts with three operations:
Expand Down
Binary file modified data/readme_images/architecture.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified data/readme_images/softplus.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 3103fe8

Please sign in to comment.