Conduit - Data Integration for Production Data Stores

Overview

Conduit

Logo

Data Integration for Production Data Stores. đź’«

License Build Go Reference Discord Docs

Overview

Conduit is a data streaming tool written in Go. It aims to provide the best user experience for building and running real-time data pipelines. Conduit comes with batteries included, it provides a UI, common connectors, transforms and observability data out of the box.

Conduit pipelines are built out of simple building blocks which run in their own goroutines and are connected using Go channels. This makes Conduit pipelines incredibly performant on multi-core machines. Conduit guarantees the order of received records won't change, it also takes care of consistency by propagating acknowledgments to the start of the pipeline only when a record is successfully processed on all destinations.

Conduit connectors are plugins that communicate with Conduit via a gRPC interface. This means that plugins can be written in any language as long as they conform to the required interface.

Conduit was created and open-sourced by Meroxa.

Installation guide

Download release

Download a pre-built binary from the latest release and simply run it!

./conduit

Once you see that the service is running you may access a user-friendly web interface at http://localhost:8080/ui/. You can also interact with the Conduit API directly, we recommend navigating to http://localhost:8080/openapi/ and exploring the HTTP API through Swagger UI.

Build from source

Requirements:

git clone [email protected]:ConduitIO/conduit.git
cd conduit
make build
./conduit

Note that you can also build Conduit with make build-server, which only compiles the server and skips the UI. This command requires only Go and builds the binary much faster. That makes it useful for development purposes or for running Conduit as a simple backend service.

Docker

Our Docker images are hosted on GitHub's Container Registry. To pull the latest tag, you should run the following in your command line:

docker pull ghcr.io/conduitio/conduit:latest

The Docker images include the UI and the following plugins: S3, Postgres, Kafka, file and generator.

Testing

Conduit tests are split in two categories: unit tests and integration tests. Unit tests can be run without any additional setup while integration tests require additional services to be running (e.g. Kafka or Postgres).

Unit tests can be run with make test.

Integration tests require Docker to be installed and running, they can be run with make test-integration. This command will handle starting and stopping docker containers for you.

API

Conduit exposes a gRPC API and an HTTP API.

The gRPC API is by default running on port 8084. You can define a custom address using the CLI flag -grpc.address. To learn more about the gRPC API please have a look at the protobuf file.

The HTTP API is by default running on port 8080. You can define a custom address using the CLI flag -http.address. It is generated using gRPC gateway and is thus providing the same functionality as the gRPC API. To learn more about the HTTP API please have a look at the OpenAPI definition or run Conduit and navigate to http://localhost:8080/openapi/ to open a Swagger UI which makes it easy to try it out.

UI

Conduit comes with a web UI that makes building data pipelines a breeze, you can access it at http://localhost:8080/ui/. See the installation guide for instructions on how to build Conduit with the UI.

For more information about the UI refer to the Readme in /ui.

animation

Documentation

To learn more about how to use Conduit visit docs.conduit.io.

If you are interested in internals of Conduit we have prepared some technical documentation:

Known limitations

While Conduit is built on strong foundations and experiences from running similar systems, it's not production ready at the moment. Following features are on the roadmap and yet to be implemented:

  1. Standard record format - we plan to have the records implement a single standard for CDC events.
  2. Delivery and ordering guarantees - from the experience we have so far, messages created internally are reliably delivered through Conduit (from source nodes, over processing nodes to destination nodes). However, we still need good end-to-end, full-scale tests to actually prove that.
  3. Performance guarantees (for the core) - reasons are identical to reasons for delivery guarantees.
  4. Dynamic loading of list of plugins - currently, the API cannot return the list of all available plugins and the available configuration parameters. Consequently, the UI has the plugin paths and configuration parameters hard-coded.

Contributing

For a complete guide to contributing to Conduit, see the Contribution Guide.

We welcome you to join the community and contribute to Conduit to make it better! When something does not work as intended please check if there is already an issue that describes your problem, otherwise please open an issue and let us know. When you are not sure how to do something please open a discussion or hit us up on Discord.

We also value contributions in form of pull requests. When opening a PR please ensure:

  • You have followed the Code Guidelines.
  • There is no other pull request for the same update/change.
  • You have written unit tests.
  • You have made sure that the PR is of reasonable size and can be easily reviewed.
Comments
  • New connector plugin interface

    New connector plugin interface

    Description

    This PR combines the work of 11 different PRs that were separately reviewed:

    • https://github.com/ConduitIO/conduit/pull/84
    • https://github.com/ConduitIO/conduit/pull/85
    • https://github.com/ConduitIO/conduit/pull/86
    • https://github.com/ConduitIO/conduit/pull/87
    • https://github.com/ConduitIO/conduit/pull/88
    • https://github.com/ConduitIO/conduit/pull/123
    • https://github.com/ConduitIO/conduit/pull/170
    • https://github.com/ConduitIO/conduit/pull/262
    • https://github.com/ConduitIO/conduit/pull/279
    • https://github.com/ConduitIO/conduit/pull/231
    • https://github.com/ConduitIO/conduit/pull/239

    Closes #65, closes #218, closes #219, closes #174, closes #156.

    opened by lovromazgon 17
  • feat(ui): stream inspector

    feat(ui): stream inspector

    Description

    Adds stream inspector functionality to the UI

    Demo

    Screen Shot 2022-12-06 at 9 31 27 AM Screen Shot 2022-12-06 at 9 29 07 AM Screen Shot 2022-12-06 at 9 29 16 AM

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by jmar910 8
  • [UI] Add runtime API URL host

    [UI] Add runtime API URL host

    Description

    Generally, API hosts (and other environment variables) are written at build time if not using the same host. Since we build the conduit UI into the conduit binary, we do not know at build time what the API host is, so we fallback to ember-data and axios with no host.

    There is some further work slated to further define and optimize our configurations for enabling/disabling the UI (and other configurations). See #32

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by jmar910 8
  • ci(lint): add linter task to ui CI workflow

    ci(lint): add linter task to ui CI workflow

    Description

    This adds a CI linter task for the ui project that will be run on any open pull requests, as well as commits to the main branch of the project.

    This change is motivated by the recent dependabot upgrade of the template linter dependency. Right now, it is not possible, when reviewing a dependabot PR related to UI linter utilities, to infer if the version upgrade will cause any issues for our linter workflow

    After merging this PR, we would now see the CI failing if linter upgrades either surface new linting errors or break our linting flow all together.

    Follow-up to https://github.com/ConduitIO/conduit/pull/421 Reference: https://github.com/ConduitIO/conduit/pull/421#issuecomment-1156316979

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests. (not applicable)
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by jayjayjpg 7
  • fix(ui): dynamic config validation fixes

    fix(ui): dynamic config validation fixes

    Description

    • Fixes it so that we consolidate cases where both greater than and less than validations are present on one number field
    • Fixes wrong variable name for custom validation message
    • Adds isRequired parameter to dynamic validations to signal optional fields can allow blank values
    • Adds test for consolidation case

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by jmar910 6
  • Update descriptions for hoist and insert transforms

    Update descriptions for hoist and insert transforms

    Description

    Updates the descriptions for HoistField and InsertField transforms in the Conduit UI

    Fixes # (issue)

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [ ] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by devarismeroxa 6
  • Stream inspector for destinations

    Stream inspector for destinations

    Description

    Depends on #732 Fixes #700

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by hariso 6
  • Add pipeline running validations

    Add pipeline running validations

    Description

    Add a pipeline running validation to prevent the user from updating transforms or editing pipeline settings while the pipeline is running

    Fixes https://github.com/ConduitIO/conduit/issues/145

    Screenshots

    Screen Shot 2022-04-01 at 1 58 31 PM Screen Shot 2022-04-01 at 1 58 35 PM Screen Shot 2022-04-01 at 1 58 39 PM

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [x] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by jmar910 6
  • Set version tag in goreleaser

    Set version tag in goreleaser

    Description

    Makes sure that the version tag is set when goreleaser builds the binary. We'll see if it works once we merge it and the next nightly is built.

    Fixes #162

    opened by lovromazgon 5
  • Pipeline stuck in running state with very fast source and a failing destination

    Pipeline stuck in running state with very fast source and a failing destination

    Bug description

    This bug was originally reported by @lyuboxa. He reported a problem with a pipeline with:

    • a Kafka source with a topic with a very large number of messages, and
    • a Kafka destination with a topic which actually doesn't exist.

    The logs show:

    2022-10-06T17:22:20+00:00 ERR error writing record error="failed to produce messages: [3] Unknown Topic Or Partition: the request is for a topic or partition that does not exist on this broker" connector_id=pipeline1:destination1 plugin_name=builtin:kafka plugin_type=destination record_position=74571ce2-52b4-436e-8a4d-4ed8c92906e7
    

    The pipeline, however, is in a running state.

    When trying to stop it, we get:

    {
        "code": 13,
        "details": [],
        "message": "failed to stop pipeline: tried to inject control message but PubNode is not running"
    }
    

    This issue can be reproduced with a very fast generator source and a Kafka destination which is failing. In the example below, the failure comes from the destination topic not existing, and the Kafka broker not allowing auto-create of topics.

    Steps to reproduce

    ---
    version: 1.0
    pipelines:
      pipeline1:
        status: running
        name: pipeline1
        description: 'Fast generator source, Kafka destination'
        connectors:
          source1:
            type: source
            plugin: builtin:generator
            name: generator-source
            settings:
              recordCount: "-1"
              readTime: "0ms"
              format.options: "id:int,name:string,company:string,trial:bool"
              format.type: "structured"
          destination1:
            type: destination
            plugin: "builtin:kafka"
            name: kafka-destination
            settings:
              servers: "localhost:9092"
              topic: "non-existing-topic"
    
    

    Version

    v0.4.0-nightly.20221006

    bug 
    opened by hariso 4
  • npm: bump autoprefixer from 10.4.7 to 10.4.8 in /ui

    npm: bump autoprefixer from 10.4.7 to 10.4.8 in /ui

    Bumps autoprefixer from 10.4.7 to 10.4.8.

    Release notes

    Sourced from autoprefixer's releases.

    10.4.8

    • Do not print color-adjust warning if print-color-adjust also is in rule.
    Changelog

    Sourced from autoprefixer's changelog.

    10.4.8

    • Do not print color-adjust warning if print-color-adjust also is in rule.
    Commits
    • 65e2dae Release 10.4.8 version
    • 9b670b4 Do not print warning if print-color-adjust is also in the rule
    • bcc5ff6 Update dependencies and example in docs
    • 616c442 Simplify CI config
    • See full diff in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 4
  • GoReleaser: archive name replacements

    GoReleaser: archive name replacements

    Description

    Handles https://goreleaser.com/deprecations/#archivesreplacements.

    Quick checks:

    • [x] I have followed the Code Guidelines.
    • [x] There is no other pull request for the same update/change.
    • [ ] I have written unit tests.
    • [x] I have made sure that the PR is of reasonable size and can be easily reviewed.
    opened by hariso 0
  • npm: bump @ember/test-helpers from 2.8.1 to 2.9.3 in /ui

    npm: bump @ember/test-helpers from 2.8.1 to 2.9.3 in /ui

    Bumps @ember/test-helpers from 2.8.1 to 2.9.3.

    Release notes

    Sourced from @​ember/test-helpers's releases.

    Release 2.9.3

    :bug: Bug Fix

    Committers: 1

    Release 2.9.2

    :bug: Bug Fix

    Committers: 1

    Release 2.9.1

    Note: these were all back-ported from master since they could go out on 2.9. This will be the last 2.9 release unless there are critical bug fixes here!

    :bug: Bug Fix

    • Let ESLint have its way about docstring location (a8fac83)
    • DOC: API: add render helper examples (f476a20)
    • Tweak TS style for indexing multiple types (for getElement) (f01ad9f)
    • Use export type for RenderingTestContext (2dc5077)
    • Tweak TS style for indexing multiple types (3214483)
    • Address PR feedback (5e87a54)
    • DOC: API: add DOM query helper examples (83b7f5f)
    • Export type for Target (335019d)
    • Upgrade expect-type and fix issues the new version reveals (bae5e33)
    • Correctly handle special char keyCodes with Shift (d537923)
    • Add tab type test (64f40d5)
    • Generate documentation (939f29f)
    • Ensure types reflect optional-ness of tab options (95285cc)
    • Fix typesVersions config again (53fa899)
    • Clean up public-types after pack (b9dcbca)

    Release 2.9.0

    :rocket: Enhancement

    :bug: Bug Fix

    ... (truncated)

    Changelog

    Sourced from @​ember/test-helpers's changelog.

    v2.9.3 (2022-12-21)

    :bug: Bug Fix

    Committers: 1

    v2.9.2 (2022-12-21)

    :bug: Bug Fix

    Committers: 1

    v2.9.1 (2022-12-16)

    Note: these were all back-ported from master since they could go out on 2.9. This will be the last 2.9 release unless there are critical bug fixes here!

    :bug: Bug Fix

    • Let ESLint have its way about docstring location (a8fac83)
    • DOC: API: add render helper examples (f476a20)
    • Tweak TS style for indexing multiple types (for getElement) (f01ad9f)
    • Use export type for RenderingTestContext (2dc5077)
    • Tweak TS style for indexing multiple types (3214483)
    • Address PR feedback (5e87a54)
    • DOC: API: add DOM query helper examples (83b7f5f)
    • Export type for Target (335019d)
    • Upgrade expect-type and fix issues the new version reveals (bae5e33)
    • Correctly handle special char keyCodes with Shift (d537923)
    • Add tab type test (64f40d5)
    • Generate documentation (939f29f)
    • Ensure types reflect optional-ness of tab options (95285cc)
    • Fix typesVersions config again (53fa899)
    • Clean up public-types after pack (b9dcbca)

    v2.9.0 (2022-12-14)

    :rocket: Enhancement

    :bug: Bug Fix

    ... (truncated)

    Commits
    • 51804d7 Release 2.9.3
    • caef86e Merge pull request #1305 from dfreeman/render-any-object-v2
    • 20c6cf9 Avoid unnecessarily relying on Glimmer's internal component manager type
    • 421d2a0 render accepts any object with a component manager
    • e3f1cb8 Release 2.9.2
    • 6675e10 Merge pull request #1302 from emberjs/backport-fix
    • a34c29b Remove the index signature from TestContext
    • b487c05 Merge pull request #1303 from emberjs/fix-resumeTest
    • 1d22a8e TestContext.resumeTest() returns void, not Promise\<void>
    • 6d57025 Fix up CHANGELOG for 2.9.1
    • Additional commits viewable in compare view
    Maintainer changes

    This version was pushed to npm by chriskrycho, a new releaser for @​ember/test-helpers since your current version.


    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 0
  • npm: bump eslint-plugin-ember from 11.0.6 to 11.4.0 in /ui

    npm: bump eslint-plugin-ember from 11.0.6 to 11.4.0 in /ui

    Bumps eslint-plugin-ember from 11.0.6 to 11.4.0.

    Release notes

    Sourced from eslint-plugin-ember's releases.

    Release 11.4.0

    :rocket: Enhancement

    :house: Internal

    Committers: 2

    Release 11.3.1

    :bug: Bug Fix

    :house: Internal

    Committers: 2

    Release 11.3.0

    :rocket: Enhancement

    :memo: Documentation

    • #1693 Mention ESLint overrides for glob patterns in no-restricted-service-injections rule doc (@​bmish)

    Committers: 3

    Release 11.2.1

    :bug: Bug Fix

    • #1687 Don't lose optional chaining with objectAt in autofix for no-array-prototype-extensions rule (@​52052100)

    :house: Internal

    Committers: 2

    ... (truncated)

    Changelog

    Sourced from eslint-plugin-ember's changelog.

    v11.4.0 (2022-12-30)

    :rocket: Enhancement

    :house: Internal

    Committers: 2

    v11.3.1 (2022-12-21)

    :bug: Bug Fix

    :house: Internal

    Committers: 2

    v11.3.0 (2022-12-20)

    :rocket: Enhancement

    :memo: Documentation

    • #1693 Mention ESLint overrides for glob patterns in no-restricted-service-injections rule doc (@​bmish)

    Committers: 3

    v11.2.1 (2022-11-30)

    :bug: Bug Fix

    • #1687 Don't lose optional chaining with objectAt in autofix for no-array-prototype-extensions rule (@​52052100)

    :house: Internal

    ... (truncated)

    Commits
    • 92e9cf1 Release 11.4.0
    • e965de5 Add new rule no-deprecated-router-transition-methods (#1715)
    • 6cc7860 Add new rule no-implicit-injections (#1714)
    • 78cbc5a Deprecate trivial node type check helpers (#1720)
    • 96a5111 build(deps-dev): Bump eslint-doc-generator from 1.1.0 to 1.3.0 (#1716)
    • bbc184c build(deps-dev): Bump @​babel/plugin-proposal-decorators (#1717)
    • 7ed2866 build(deps-dev): Bump @​typescript-eslint/parser from 5.46.1 to 5.47.0 (#1718)
    • 445ff42 build(deps-dev): Bump jquery from 3.6.2 to 3.6.3 (#1719)
    • dcff4c3 Release 11.3.1
    • 389234a Fix crash with no-tracked-properties-from-args rule (#1712)
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 0
  • npm: bump qunit from 2.19.1 to 2.19.3 in /ui

    npm: bump qunit from 2.19.1 to 2.19.3 in /ui

    Bumps qunit from 2.19.1 to 2.19.3.

    Release notes

    Sourced from qunit's releases.

    2.19.3

    Fixed

    • Assert: Restore how deepEqual treats imposter objects. #1706

    2.19.2

    Changed

    Fixed

    • Core: Fix inaccurate count in reporter output after re-run. #1687
    • CLI: Fix MaxListeners warning in long-running watch mode. #1692
    Changelog

    Sourced from qunit's changelog.

    2.19.3 / 2022-10-22

    Fixed

    • Assert: Restore how deepEqual treats imposter objects. (Timo Tijhof) #1706

    2.19.2 / 2022-10-17

    Changed

    • Core: Faster diffing for config.noglobals by refactoring slow mutations. (Izel Nakri) #1697
    • Assert: Improve performance of QUnit.equiv(). (Izel Nakri) #1700
    • Assert: Faster deepEqual for Map values by avoiding typeEquiv calls. (Timo Tijhof)
    • Assert: Faster deepEqual by reducing internal objectType checks. (Timo Tijhof)
    • Assert: Faster deepEqual by using re-assignment for internal pairs. (Timo Tijhof)

    Fixed

    • Core: Fix inaccurate count in reporter output after re-run. #1687
    • CLI: Fix MaxListeners warning in long-running watch mode. #1692
    Commits
    • 4319b8a Release 2.19.3
    • 8520cd3 Build: Prepare 2.19.3 release
    • 12f5c63 Build: Update rollup and other dev deps
    • d5715a8 Build: Add Node 18 to matrix, update default to Node 16
    • 49b20d3 Test: Fix flaky macOS builds by waiting for spawned.on('close')
    • ab8a9b3 Assert: Revert change in how deepEqual treats imposter objects
    • a10122c Build: Prepare 2.19.2 release
    • 9d8aba1 CLI: Avoid MaxListeners warning in long-running watch mode
    • bc1cc38 Core: Fix inaccurate test count in reporter output after re-run
    • e04ec8a Docs: Add ESM dynamic import example and integration test
    • Additional commits viewable in compare view

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 0
  • npm: bump webpack from 5.74.0 to 5.75.0 in /ui

    npm: bump webpack from 5.74.0 to 5.75.0 in /ui

    Bumps webpack from 5.74.0 to 5.75.0.

    Release notes

    Sourced from webpack's releases.

    v5.75.0

    Bugfixes

    • experiments.* normalize to false when opt-out
    • avoid NaN%
    • show the correct error when using a conflicting chunk name in code
    • HMR code tests existance of window before trying to access it
    • fix eval-nosources-* actually exclude sources
    • fix race condition where no module is returned from processing module
    • fix position of standalong semicolon in runtime code

    Features

    • add support for @import to extenal CSS when using experimental CSS in node
    • add i64 support to the deprecated WASM implementation

    Developer Experience

    • expose EnableWasmLoadingPlugin
    • add more typings
    • generate getters instead of readonly properties in typings to allow overriding them
    Commits

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 0
  • npm: bump ember-qunit from 5.1.5 to 6.1.1 in /ui

    npm: bump ember-qunit from 5.1.5 to 6.1.1 in /ui

    Bumps ember-qunit from 5.1.5 to 6.1.1.

    Release notes

    Sourced from ember-qunit's releases.

    Release 6.1.1

    :bug: Bug Fix

    Committers: 1

    v6.1.0

    :rocket: Enhancement

    :house: Internal

    Committers: 4

    Release 6.0.0

    :boom: Breaking Change

    :rocket: Enhancement

    :bug: Bug Fix

    :house: Internal

    Committers: 3

    Changelog

    Sourced from ember-qunit's changelog.

    v6.1.1 (2022-12-19)

    :bug: Bug Fix

    Committers: 1

    v6.1.0 (2022-12-16)

    :rocket: Enhancement

    :house: Internal

    Committers: 4

    v6.0.0 (2022-10-07)

    :boom: Breaking Change

    :rocket: Enhancement

    :bug: Bug Fix

    :house: Internal

    Committers: 3

    Commits
    • b038aad Release 6.1.1
    • ca2a2b7 Merge pull request #999 from emberjs/bump-resolver
    • 6f851ac Use native types from ember-resolver
    • 492c39d Merge pull request #998 from emberjs/fix-types
    • be8b97b Revert explicit peerDependencies contracts
    • 3396e9a Merge pull request #996 from emberjs/release-6.1-ugh
    • d2cfced Re-apply version bump to CHANGELOG and package.json
    • 54b5e70 Merge pull request #995 from emberjs/ts-defs-only
    • d4b0013 Fix CI invocation for type tests
    • 8485183 Feature: introduce native (ambient) TS types
    • Additional commits viewable in compare view
    Maintainer changes

    This version was pushed to npm by chriskrycho, a new releaser for ember-qunit since your current version.


    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies javascript 
    opened by dependabot[bot] 0
Releases(v0.5.0-nightly.20230103)
Production-Grade Container Scheduling and Management

Kubernetes (K8s) Kubernetes, also known as K8s, is an open source system for managing containerized applications across multiple hosts. It provides ba

Kubernetes 94.8k Jan 2, 2023
How to build production-level services in Go leveraging the power of Kubernetes

Ultimate Service Copyright 2018, 2019, 2020, 2021, Ardan Labs [email protected] Ultimate Service 3.0 Classes This class teaches how to build producti

null 0 Oct 22, 2021
Simple Tools to help manage non-production Kubernetes Clusters

SecondMate.io A tool to help your nonProduction Kubernetes Clusters running clean. The goal of this tool is to add some features to non production clu

Corey McGalliard 1 Feb 21, 2022
A demo repository that shows CI/CD integration using DroneCI + ArgoCD + Kubernetes.

CI/CD Demo This is the demo repo for my blog post. This tutorial shows how to build CI/CD pipeline with DroneCI and ArgoCD. In this demo, we use Drone

Hao-Ming, Hsu 43 Oct 18, 2022
Golang Integration Testing Framework For Kong Kubernetes APIs and Controllers.

Kong Kubernetes Testing Framework (KTF) Testing framework used by the Kong Kubernetes Team for the Kong Kubernetes Ingress Controller (KIC). Requireme

Kong 26 Dec 20, 2022
TriggerMesh open source event-driven integration platform powered by Kubernetes and Knative.

TriggerMesh open source event-driven integration platform powered by Kubernetes and Knative. TriggerMesh allows you to declaratively define event flows between sources and targets as well as add even filter, splitting and processing using functions.

TriggerMesh 373 Dec 30, 2022
Mutagen Compose is a modified version of Docker Compose that offers automated integration with Mutagen.

Mutagen Compose Mutagen Compose is a (minimally) modified version of Docker Compose that offers automated integration with Mutagen. This allows you to

Mutagen 81 Dec 22, 2022
A best practices Go source project with unit-test and integration test, also use skaffold & helm to automate CI & CD at local to optimize development cycle

Dependencies Docker Go 1.17 MySQL 8.0.25 Bootstrap Run chmod +x start.sh if start.sh script does not have privileged to run Run ./start.sh --bootstrap

Quang Nguyen 4 Apr 4, 2022
Stuff to make standing up sigstore (esp. for testing) easier for e2e/integration testing.

sigstore-scaffolding This repository contains scaffolding to make standing up a full sigstore stack easier and automatable. Our focus is on running on

Ville Aikas 40 Dec 27, 2022
Mango-kong - Mango (man page generator) integration for Kong

Mango (man page generator) integration for Kong This package allows Kong package

Alec Thomas 15 Dec 5, 2022
HBase Exporter,fetch data from jmx for region-level data.

HBase Exporter Prometheus exporter for HBase which fetch data from hbase jmx, written in Go. You can even see region-level metrics. Installation and U

David 13 Nov 4, 2022
Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.

Kstone 中文 Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd

TKEStack 596 Dec 27, 2022
đź’§ Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack

Website | Community | Blog Get Early Access Visual Data Preparation (VDP) is an open-source tool to streamline the end-to-end visual data processing p

Instill AI 646 Jan 5, 2023
Kubesecret is a command-line tool that prints secrets and configmaps data of a kubernetes cluster.

Kubesecret Kubesecret is a command-line tool that prints secrets and configmaps data of a kubernetes cluster. kubesecret -h for help pages. Install go

Charalampos Mitrodimas 18 May 3, 2022
Terraform utility provider for constructing bash scripts that use data from a Terraform module

Terraform Bash Provider This is a Terraform utility provider which aims to robustly generate Bash scripts which refer to data that originated in Terra

Martin Atkins 33 Sep 6, 2022
Collect data about your dependencies

Collect data about your dependencies Features and Data Sources: Go modules, runs tests, detects tests and benchmarks Flexible rendering with Graphviz,

Nikolay Dubina 36 Dec 20, 2022
A tool to dump and restore Prometheus data blocks.

promdump promdump dumps the head and persistent blocks of Prometheus. It supports filtering the persistent blocks by time range. Why This Tool When de

Ivan Sim 111 Dec 16, 2022
AWS Data Transfer Cost Explorer

The AWS Data Transfer Cost Explorer The AWS Data Transfer Cost Explorer tool analyzes the billed Data Transfer items in your AWS account and presents

OÄźuzhan YILMAZ 90 Jul 18, 2022
Snowflake grafana datasource plugin allows Snowflake data to be visually represented in Grafana dashboards.

Snowflake Grafana Data Source With the Snowflake plugin, you can visualize your Snowflake data in Grafana and build awesome chart. Get started with th

Michelin 39 Dec 29, 2022