Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

These commit is mostly resolve the memory leak problem and optimize memory usage to handle millions of requests #81

Open
wants to merge 17 commits into
base: master
Choose a base branch
from

Commits on Nov 28, 2021

  1. Configuration menu
    Copy the full SHA
    70287ab View commit details
    Browse the repository at this point in the history

Commits on May 4, 2022

  1. Configuration menu
    Copy the full SHA
    ff94fc8 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2022

  1. Support GET param ?includeHeaders=true to generate rich message forma…

    …t that contains both HTTP headers and body as a single message
    truong-hua committed May 9, 2022
    Configuration menu
    Copy the full SHA
    43ee835 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. Configuration menu
    Copy the full SHA
    c2e3604 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2022

  1. Configuration menu
    Copy the full SHA
    b747439 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. Configuration menu
    Copy the full SHA
    191e652 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1ada8fa View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9d42172 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    ce0a8b2 View commit details
    Browse the repository at this point in the history
  5. Add WorkerPoolSize configuration which is to allow limit the number o…

    …f concurrency of receiver
    truong-hua committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    5a0f082 View commit details
    Browse the repository at this point in the history
  6. Fork predefined goroutine as worker and reuse memory buffer to reduce…

    … pressure on GC which reduce a lot of CPU usage and memory usage when receive hugh amount number of request
    truong-hua committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    aebdade View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e5c06f2 View commit details
    Browse the repository at this point in the history
  8. Allow to define an empty string config via environment variable, whic…

    …h is very useful to allow user to disable a config
    truong-hua committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    8ff3d1b View commit details
    Browse the repository at this point in the history
  9. Allow configurable HTTP header that use to pass Pulsar token. This co…

    …mmit prevent confiction when using Authorization header for both JWT and Pulsar token and may be other authorization purpose.
    
    Without this commit, using Authorization header as Pulsar token may cause memory leak because of token change per every request cause pulsar-beam to create a new pulsar client every time.
    With configurable Authorization, user can also use ?includeHeader to get Authorization header to validate a payload without casuing pulsar-beam memory leak
    truong-hua committed Jul 7, 2022
    Configuration menu
    Copy the full SHA
    1c8c372 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2022

  1. Allow to specify ?includeRequestLine=true in the url to include HTTP …

    …Request Line in the payload to send to Pulsar, which is useful in case of Pulsar consumer would like to detect the url or method that webhook client is using
    truong-hua committed Jul 8, 2022
    Configuration menu
    Copy the full SHA
    8a04220 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. Configuration menu
    Copy the full SHA
    4246a28 View commit details
    Browse the repository at this point in the history
  2. Add an notice about memory leak if using default Pulsar Beam configur…

    …ation with a reverse proxy engine in front of or using other Authorization method.
    
    This commit also add a short brief to let people know how to detect memory leak and resolve it. Further default configuration of Pulsar Beam should prevent this case from happening.
    truong-hua committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    5f067cc View commit details
    Browse the repository at this point in the history