SizedWaitGroup has the same role and close to the same API as the Golang sync.WaitGroup but it adds a limit on the amount of goroutines started concurrently.

Rémy Mathieu

Last update: Jan 8, 2023

Related tags

Performance sizedwaitgroup

Overview

SizedWaitGroup

SizedWaitGroup has the same role and API as sync.WaitGroup but it adds a limit of the amount of goroutines started concurrently.

SizedWaitGroup adds the feature of limiting the maximum number of concurrently started routines. It could for example be used to start multiples routines querying a database but without sending too much queries in order to not overload the given database.

Example

package main

import (
        "fmt"
        "math/rand"
        "time"

        "github.com/remeh/sizedwaitgroup"
)

func main() {
        rand.Seed(time.Now().UnixNano())

        // Typical use-case:
        // 50 queries must be executed as quick as possible
        // but without overloading the database, so only
        // 8 routines should be started concurrently.
        swg := sizedwaitgroup.New(8)
        for i := 0; i < 50; i++ {
                swg.Add()
                go func(i int) {
                        defer swg.Done()
                        query(i)
                }(i)
        }

        swg.Wait()
}

func query(i int) {
        fmt.Println(i)
        ms := i + 500 + rand.Intn(500)
        time.Sleep(time.Duration(ms) * time.Millisecond)
}

License

MIT

Copyright

A small library to detect if an IP address is close to yours

go-geofence A small library to detect if an IP address is close to yours or another of your choosing using https://ipstack.com/ Usage First you will n

17 Aug 10, 2022

A close implementation of JavaScript's Set written in Go

Set The Set struct allows unique values storing of any type. Initializing a Set s := set.New() // Empty Set s := set.New("hi", 45, Person{name: "Gophe

0 Dec 20, 2021

There is a certain amount of work to be done before you can implement the features of your Go powered CLI app

go-project-template-cli There is a certain amount of work to be done before you can implement the features of your Go powered CLI app. A few of those

0 Jan 23, 2022

iflandown runs commands after the wired LAN link is down for a given amount of time.

iflandown iflandown runs commands after the wired LAN link is down for a given amount of time. All/most linux devices should work. Tested on amd64, Ra

1 Mar 16, 2022

This is a close to decentralized RSS3 Network implementation of RSS3 protocol v0.4.0 with full indexing function in Go

48 Aug 4, 2022

grafana-sync Keep your grafana dashboards in sync.

grafana-sync Keep your grafana dashboards in sync. Table of Contents grafana-sync Table of Contents Installing Getting Started Pull Save all dashboard

169 Dec 14, 2022

Simple boilerplate code to get started with building and deploying a serverless CRUD API

Simple boilerplate code to get started with building and deploying a serverless CRUD API with Go, MongoDB and Netlify

2 Jan 20, 2022

Template project to get started with a simple API skeleton in Go and Docker

A template project to create a Docker image for a Go application. The example application exposes an HTTP endpoint through a REST API packaged as a static binary.

11 Apr 4, 2022

Same as fmt.Errorf but with stack trace.

Annotation with stack trace for go1.13 Go 1.13 contains support for error wrapping. Now you can add additional information to an error by wrapping it

39 Dec 25, 2020

x/sync/singleflight but with Go 1.18 generics

singleflight This repo is a hard fork of golang.org/x/sync/singleflight that adds generics to the Group type so that there is no need for type asserti

24 Nov 22, 2022

InkCaller is an API to call Ink. Each new call is independent and can be executing concurrently

inkcaller This library InkCaller is an API to call Ink. Each new call is independent and can be executing concurrently. A call will force the ink stat

0 Feb 8, 2022

goRBAC provides a lightweight role-based access control (RBAC) implementation in Golang.

goRBAC goRBAC provides a lightweight role-based access control implementation in Golang. For the purposes of this package: * an identity has one or mo

1.4k Dec 29, 2022

Go Getting Started from PluralSight. Simple webapp in golang

Go_WEB_APP Go Getting Started from PluralSight. Simple webapp in golang This is simple Webapp in GO, which has users api to interact with backend This

0 Oct 18, 2021

Training materials and labs for a "Getting Started" level course on COBOL

COBOL Programming Course This project is a set of training materials and labs for COBOL on z/OS. The following books are available within this reposit

2.4k Dec 30, 2022

vcluster - Create fully functional virtual Kubernetes clusters - Each cluster runs inside a Kubernetes namespace and can be started within seconds

Website • Quickstart • Documentation • Blog • Twitter • Slack vcluster - Virtual Clusters For Kubernetes Lightweight & Low-Overhead - Based on k3s, bu

2.3k Jan 4, 2023

Comments

LICENSE file would help adoption

This is a nice piece of code. It would be easier to include/reference in other projects if it had a LICENSE file with the MIT license in it. Lawyers get grumpy about these things.

opened by danielbprice 1
Use math.MaxInt32 instead of hardcoding the value

First of all, thanks for creating and sharing a nice library!

This pull request is just a nitpick, but it is better to use the the constant defined than hardcoding the value.

opened by hnakamur 1
errgroup

Am I right in thinking the use case here is very similar to golang.org/x/sync/errgroup ?

If so, it would be good to add something to the README that mentions why someone might use this library instead of errgroup.

opened by porjo 0
An inappropriate use of `break-select`

I noticed a break-select in sizewaitgroup.go, which was used in AddWithContext Method, but break keyword can not jump out of the select in Golang. Although it looks like properly worked in this method, but it`s still confusing and misunderstanding.

opened by faasdfasdfasdfasd 0

SizedWaitGroup has the same role and close to the same API as the Golang sync.WaitGroup but it adds a limit on the amount of goroutines started concurrently.

Related tags

Overview

SizedWaitGroup

Example

License

Copyright

You might also like...

A small library to detect if an IP address is close to yours

A close implementation of JavaScript's Set written in Go

There is a certain amount of work to be done before you can implement the features of your Go powered CLI app

iflandown runs commands after the wired LAN link is down for a given amount of time.

This is a close to decentralized RSS3 Network implementation of RSS3 protocol v0.4.0 with full indexing function in Go

grafana-sync Keep your grafana dashboards in sync.

Simple boilerplate code to get started with building and deploying a serverless CRUD API

Template project to get started with a simple API skeleton in Go and Docker

Same as fmt.Errorf but with stack trace.

x/sync/singleflight but with Go 1.18 generics

InkCaller is an API to call Ink. Each new call is independent and can be executing concurrently

goRBAC provides a lightweight role-based access control (RBAC) implementation in Golang.

Go Getting Started from PluralSight. Simple webapp in golang

Training materials and labs for a "Getting Started" level course on COBOL

vcluster - Create fully functional virtual Kubernetes clusters - Each cluster runs inside a Kubernetes namespace and can be started within seconds

Terraform ACI Provider. Started before Cisco's release and stopped when Cisco released its own.

🔑 Authz0 is an automated authorization test tool. Unauthorized access can be identified based on URL and Role.

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Role Based Access Control (RBAC) with database persistence

Comments

LICENSE file would help adoption

Use math.MaxInt32 instead of hardcoding the value

errgroup

An inappropriate use of `break-select`

Releases(v1.0.0)

v1.0.0(Nov 17, 2019)

Owner

Rémy Mathieu

Concurrence-go - This project shows the use of concurrence in Golang

Speed up the memory allocation and improve the GC performance, especially for dynamic-memory-heavy applications.

A sync.WaitGroup with error handling and concurrency control

sync.WaitGroup for concurrent use

Limit-order-book - Limit order books keep records of orders for a given symbol to be traded

Limits the number of goroutines that are allowed to run concurrently

GopherTalk: a multi-user chat powered by GO to explore its standard library and features like sockets, goroutines, channels and sync package

its the same idea as bruh-bot, but with golang, and add more bots

Aquatone is a tool for visual inspection of websites across a large amount of hosts and is convenient for quickly gaining an overview of HTTP-based attack surface.

port close check scanner. detects open ports, sends alert with slack.