Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Th2 4571 event batcher size limit #81

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
8 changes: 4 additions & 4 deletions .github/workflows/dev-docker-matrix-publish.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,11 +24,11 @@ jobs:
- uses: actions/checkout@v2
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v1
- uses: docker/login-action@v1
- uses: docker/login-action@v2
with:
registry: ghcr.io
username: ${{ github.repository_owner }}
password: ${{ secrets.CR_PAT }}
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- run: echo "::set-output name=REPOSITORY_NAME::$(echo '${{ github.repository }}' | awk -F '/' '{print $2}')"
id: meta
# Prepare custom build version
Expand All @@ -55,4 +55,4 @@ jobs:
project_name=${{ matrix.proto }}
push: true
tags: ghcr.io/th2-net/th2-${{ matrix.proto }}:${{ steps.release_ver.outputs.value }}
labels: com.exactpro.th2.th2-${{ matrix.proto }}=${{ steps.release_ver.outputs.value }}
labels: com.exactpro.th2.th2-${{ matrix.proto }}=${{ steps.release_ver.outputs.value }}
4 changes: 2 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@ FROM gradle:6.6-jdk11 AS build
COPY ./ .
RUN gradle --no-daemon clean dockerPrepare

FROM ghcr.io/th2-net/th2-codec-sailfish:3.12.3
FROM ghcr.io/th2-net/th2-codec-sailfish:3.14.1-TH2-4571-event-batcher-size-limit-3830125244-86c4e0b
ARG project_name
WORKDIR /home
RUN echo "/home/gradle/${project_name}/build/docker"
COPY --from=build /home/gradle/${project_name}/build/docker .
COPY --from=build /home/gradle/${project_name}/build/docker .
15 changes: 13 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# General codecs (3.10.5)
# General codecs (3.11.0)

This repository contains the build scripts for general codecs:
+ [fix](codec-fix/README.md)
Expand All @@ -14,6 +14,17 @@ _Do not specify default parameters if you don't want to override them_ (just bec

# Changes

### 3.11.0 +
+ Uses event batcher which supports publication by timeout and packs events into a batch by specified count and size in bytes.

### 3.11.0

+ Dependencies with vulnerabilities was updated
+ Update base image version to 3.14.0
+ Codec handles messages with its protocol or empty during encode/decode
+ The sailfish-core library update from 3.2.1748 to 3.3.11
+ Update sailfish version for codec to 3.3.11

### 3.10.5

+ Update sailfish version to 3.2.1860
Expand Down Expand Up @@ -98,4 +109,4 @@ _Do not specify default parameters if you don't want to override them_ (just bec

## 3.1.1

+ Allow the codec to produce more than one message during the decoding a raw message
+ Allow the codec to produce more than one message during the decoding a raw message
4 changes: 2 additions & 2 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -10,8 +10,8 @@ subprojects {
resourceDir = "src/main/resources"
sharedDir = file("${project.rootDir}/shared")

baseSailfishVersion = '3.2'
sailfishVersion = "${baseSailfishVersion}.1860"
baseSailfishVersion = '3.3'
sailfishVersion = "${baseSailfishVersion}.11"

dockerCodecImplementationDir = 'codec_implementation'
}
Expand Down
6 changes: 5 additions & 1 deletion codec-fast/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,11 @@
# FAST codec
# FAST codec (3.11.0)

This codec can be used for decoding and encoding messages via FAST protocol

### Codec protocol

Codec handles messages with the `FAST` or empty protocol during encode/decode

## Configuration

### Codec factory
Expand Down
10 changes: 5 additions & 5 deletions codec-fix/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,11 @@
# FIX codec (3.10.5)
# FIX codec (3.11.0)

This codec can be used for decoding and encoding messages via FIX protocol

### Codec protocol

Codec handles messages with the `FIX` or empty protocol during encode/decode

## Configuration

### Codec factory
Expand Down Expand Up @@ -61,10 +65,6 @@ Determines if nanoseconds should be added to date-time / time fields during enco

## Release notes

+ 3.10.5
+ Update sailfish version to 3.2.1860
+ Detection of errors in FIXSession and FIXCodec during parsing qfj messages

+ 3.10.4
+ Codec cannot decode message if it contains a tag that is similar to BeginString (`8=FIX`)

Expand Down
15 changes: 13 additions & 2 deletions codec-itch/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,11 @@
# ITCH codec
# ITCH codec (3.11.0)

This codec can be used for decoding and encoding messages via ITCH protocol

### Codec protocol

Codec handles messages with the `ITCH` or empty protocol during encode/decode

## Configuration

### Codec factory
Expand All @@ -26,4 +30,11 @@ The supported values are 1 and 2.
#### wrapMessages

If set to value of `true` all of the decoded messages will be wrapped to the special message.
Otherwise, the decoded messages will be returned without wrapping them.
Otherwise, the decoded messages will be returned without wrapping them.

## Changes

### 3.11.0

+ Updated version to 3.2.1881
+ Support for 4-bytes price added for Double and BigDecimal types
8 changes: 6 additions & 2 deletions codec-ntg/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,11 @@
# NTG codec (3.10.5)
# NTG codec (3.11.0)

This codec can be used for decoding and encoding messages via NTG (Native) protocol.

### Codec protocol

Codec handles messages with the `NTG` or empty protocol during encode/decode

## Configuration

### Codec factory
Expand All @@ -17,4 +21,4 @@ This codec doesn't have any specific configuration. All the decoding/encoding re
### 3.10.5
+ Update
+ Add check scale for float and double types during encode
+ Increased accuracy of division double/float during decoding in ntg codec
+ Increased accuracy of division double/float during decoding in ntg codec
8 changes: 6 additions & 2 deletions codec-soup/README.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,14 @@
# ITCH and SOUP codecs family (3.10.5)
# ITCH and SOUP codecs family (3.11.0)

This project has codecs implementations for the following protocol:
+ ITCH
+ OUCH
+ MoldUDP64

### Codec protocol

Codec handles messages with the `SOUP` or empty protocol during encode/decode

## ITCH

Use the following parameters in codec configuration:
Expand Down Expand Up @@ -57,4 +61,4 @@ parseMessageLengthAsSeparateMessage: true
+ Add declared message length check

### 3.10.4
+ Fix decoding of EndOfSession messages in SOUP codec
+ Fix decoding of EndOfSession messages in SOUP codec
4 changes: 2 additions & 2 deletions gradle.properties
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
release_version=3.10.5
release_version=3.11.0
sf_service_name = unknown-service
docker_image_name = th2-codec-generic
docker_image_name = th2-codec-generic