Professional lightweight testing mini-framework for Go.

Overview

is GoDoc Go Report Card Build Status

Professional lightweight testing mini-framework for Go.

  • Easy to write and read
  • Beautifully simple API with everything you need: is.Equal, is.True, is.NoErr, and is.Fail
  • Use comments to add descriptions (which show up when tests fail)

Failures are very easy to read:

Examples of failures

Usage

The following code shows a range of useful ways you can use the helper methods:

func Test(t *testing.T) {

	is := is.New(t)
	
	signedin, err := isSignedIn(ctx)
	is.NoErr(err)            // isSignedIn error
	is.Equal(signedin, true) // must be signed in
	
	body := readBody(r)
	is.True(strings.Contains(body, "Hi there"))
	
}

Color

To turn off the colors, run go test with the -nocolor flag, or with the env var IS_NO_COLOR=true.

go test -nocolor
IS_NO_COLOR=true go test
Issues
  • Additional error assertations

    Additional error assertations

    Hi, let me first say that the library is great, thank you for creating it!

    I find myself repeating few checks for errors that could be made into assertation. It would be my pleasure to contribute this upgrades if we agree on their form.

    1. is.NoErr(err) is great but in lots of situations I need to check the opposite, that error is present. Using is.True(err != nil) works but does not have the same approach to assertation. I suggest adding is.Err(err) that would assert err is not nil.

    2. Usually, I add context to errors but I do not use custom error types as there is no behavior associated with this errors. When I have this situation, I would like to check that error contains a particular substring. I suggest adding is.ErrContains(err, "part of error message") that would assert if error contains given substring.

    What do you think about this two additions?

    opened by matejb 8
  • flag.Parse in init() prevents own flags in tests

    flag.Parse in init() prevents own flags in tests

    With the commit https://github.com/matryer/is/commit/46663c17c43e9963aa1aae09e7bbdbb35d7b9dda the parsing of the flags has changed to the use of flag.Parse(). Because flag.Parse() is called in init(), it prevents the source package (the one, that uses github.com/matryer/is) from defining and using it's own flags, because the calls to e.g. flag.Bool(...) will be after the execution of flag.Parse() and therefore these flags are not considered and the execution of go test fails with flag provided but not defined: ....

    This leaves us with two options:

    1. Revert the above mentioned commit
    2. Under the assumption, that this package is mainly (only) used for testing with go test, then it would also be save to remove the call to flag.Parse() in init(), because go test will execute flag.Parse()
    opened by breml 7
  • Change comment color to red

    Change comment color to red

    This changes the comment color to from green to red. Green implies success, whereas red stands out.

    There's no related issue (I can create one, if needed).

    image

    opened by WTFox 5
  • Add Helper method

    Add Helper method

    Helper marks the calling function as a test helper function. When printing file and line information, that function will be skipped.

    Adopted from testings.Helper from the stdlib.

    Related: #30

    opened by breml 4
  • -nocolor flag not supported by Go Test in go-1.11.4

    -nocolor flag not supported by Go Test in go-1.11.4

    go test without -nocolor works:

    [email protected]:~/go/src/github.com/sbward/s (master)
    $ go test ./model/
    	permissions_test.go:11: model.Permission(2) != int(1)
    --- FAIL: TestPermissionBits (0.00s)
    FAIL
    FAIL	github.com/sbward/s/model	0.009s
    

    But go test with -nocolor gives an error:

    [email protected]:~/go/src/github.com/sbward/s (master)
    $ go test ./model/ -nocolor
    flag provided but not defined: -nocolor
    ...
    
    opened by sbward 4
  • Consider using a more open license

    Consider using a more open license

    Is there a specific reason why this project uses the restrictive GPL 3 license? I for one would be able to use it in a much more relaxed way if it used a more open license like MIT.

    @matryer, would you consider switching?

    opened by cloudlena 4
  • Refactor New methods to use T interface

    Refactor New methods to use T interface

    Why

    There is no need to depend on testing package in the "production" code.

    What

    • New and NewRelaxed methods accept t T instead of t *t.testing.
    opened by pellared 3
  • Use pkg.go.dev instead of godoc.org

    Use pkg.go.dev instead of godoc.org

    Traffic from godoc.org redirects to the corresponding page on pkg.go.dev.

    P.S. Thank you for talking about this package on the Go Time podcast. Always enjoy hearing from you.

    Reference: https://blog.golang.org/godoc.org-redirect

    opened by justinpage 3
  • My editor thinks this is bad practice

    My editor thinks this is bad practice

    Hi Mat!

    Big fan (of Go of course 😏), long time listener of GoTime and working with Go full time for 4 years next month!

    So... I just tried this nice little assert library and the first thing I notice is that my editor thinks I shouldn't do this:

    is := is.New(t)
    

    It says: Variable 'is' collides with imported package name (And I hate to disappoint my editor!)

    What is your defence? (Trying to be funny 😂)

    opened by tehsphinx 3
  • Add a Contains method

    Add a Contains method

    Hi! Watched the talk you gave on The Art of Testing and really liked it. That's why I'm trying out this package, and I really like its simplicity.

    One thing though that I'm missing is a Contains method (basically this).

    As there is none so far, I guess there is some other way to do it? For example, I have a function that returns [][]string, and I wanna check if some []string are in that slice, but do not wanna specify the order.

    Thanks!

    opened by tommyknows 3
  • Create release with MIT license

    Create release with MIT license

    The current v1.0.0 release still contains the old GPL license. Could we create a new release with the new MIT license or move the existing release tag to include it?

    opened by cloudlena 2
  • Potential issue when running go test -json

    Potential issue when running go test -json

    Hey Mat, long time. Ran into a curious issue worth filing.

    Summary

    Running go test -json ... and using this package reports incorrect test names in JSON events. This could very well be a bug in Go (test2json), but figured I'd start here because if I remove is and use regular std. lib primitives it reports the correct thing.

    Reproducible example

    I noticed this happening in https://github.com/pressly/goose and put together a PR to showcase the problem.

    In this commit I purposefully changed a test to trigger a failure. Note the name of the test is TestNotAllowMissing.

    https://github.com/pressly/goose/pull/353/commits/9b7c7321bdbabb8307e71a40e0601d86b222d6ce#diff-080f0d7ba408eaf6181e1f61388995ebcd57fdd1468ffafffbf789176531418fR30

    When I run go test -v -json -count=1 ./tests/e2e -dialect=postgres I happily get JSON output. But, the test name in the JSON event doesn't line up with the Output.

    I was expecting Output that is prints to be associated with test named TestNotAllowMissing, but instead it was associated with another test named TestMigrateFull. (the name is non-deterministic, it changes between runs).

    The raw output can be found here. But I've copied and trimmed the relevant bits:

    {"Test":"TestMigrateFull","Output":"\t\u001b[90mallow_missing_test.go:30: \u001b[39m7 != 8\n"}
    {"Test":"TestNotAllowMissing","Output":"--- FAIL: TestNotAllowMissing (3.73s)\n"}
    

    The first JSON event refers to allow_missing_test.go:30, in the code base the call site on line 30 is located within the test named: TestNotAllowMissing, but the test name is TestMigrateFull.

    The second JSON event correctly outputs the failure under the test named TestNotAllowMissing.

    This could very well be a bug in how go test prints JSON events, but I suspect it may be something within this library. I say this because if I remove is from that specific test (TestNotAllowMissing) I see the expected output associated with the correct Test name:

    Raw output can be found here

    {"Test":"TestNotAllowMissing","Output":"    allow_missing_test.go:35: got 7: want: 8\n"}
    {"Test":"TestNotAllowMissing","Output":"--- FAIL: TestNotAllowMissing (2.81s)\n"}
    
    opened by mfridman 0
  • Small simplification

    Small simplification

    The following code

    	if isNil(a) || isNil(b) {
    		is.logf("%s != %s", is.valWithType(a), is.valWithType(b))
    	} else if reflect.ValueOf(a).Type() == reflect.ValueOf(b).Type() {
    		is.logf("%v != %v", a, b)
    	} else {
    		is.logf("%s != %s", is.valWithType(a), is.valWithType(b))
    	}
    

    can be simplified to

            if isNil(a) || isNil(b) || reflect.ValueOf(a).Type() != reflect.ValueOf(b).Type() {
    		is.logf("%s != %s", is.valWithType(a), is.valWithType(b))
    	} else {
    		is.logf("%v != %v", a, b)
    	}
    
    opened by kpym 0
  • Add a boolean return value to test functions

    Add a boolean return value to test functions

    I find it useful to be able to control the flow of execution in my tests depending on the outcome of previous tests. This PR adds a bool return value from test test functions.

    opened by jli-cparta 9
  • Ditch the indentation?

    Ditch the indentation?

    Hey there, thanks for creating this package. I use it in all my tests. Would you be open to removing the tab in front?

    The misalignment with other printed logs bugs me a bit (very subjective of course):

    CleanShot 2021-09-16 at 21 50 23@2x

    And with the colors, I think there's enough visual separation:

    image

    If you're up for this change, I'd be happy to open a PR.

    opened by matthewmueller 0
  • Proposal: is.Less and is.Greater

    Proposal: is.Less and is.Greater

    Would you consider adding these functions to the API? I could see it being useful for numeric comparisons but also understand that you want to keep the API to a minimum.

    Thanks.

    opened by jftuga 1
Releases(v1.4.0)
Owner
Mat Ryer
pace.dev and firesearch.dev - Gopher, developer, speaker, author (Go Programming Blueprints) - Xbar (BitBar reboot) xbarapp.com (now in beta)
Mat Ryer
A yaml data-driven testing format together with golang testing library

Specimen Yaml-based data-driven testing Specimen is a yaml data format for data-driven testing. This enforces separation between feature being tested

Design it, Run it 0 Jan 31, 2022
Golang HTTP client testing framework

flute Golang HTTP client testing framework Presentation https://speakerdeck.com/szksh/flute-golang-http-client-testing-framework Overview flute is the

Shunsuke Suzuki 17 Apr 19, 2022
API testing framework inspired by frisby-js

frisby REST API testing framework inspired by frisby-js, written in Go Proposals I'm starting to work on frisby again with the following ideas: Read s

_Hofstadter 272 Jun 13, 2022
Minimal and Beautiful Go testing framework

Goblin A Mocha like BDD testing framework written in Go that requires no additional dependencies. Requires no extensive documentation nor complicated

null 852 Jun 26, 2022
Testing framework for Go. Allows writing self-documenting tests/specifications, and executes them concurrently and safely isolated. [UNMAINTAINED]

GoSpec GoSpec is a BDD-style testing framework for the Go programming language. It allows writing self-documenting tests/specs, and executes them in p

Esko Luontola 112 Apr 5, 2022
🚀🌏 Orbital is a simple end-to-end testing framework for Go

Orbital is a test framework which enables a developer to write end to end tests just like one would writing unit tests. We do this by effectively copying the testing.T API and registering tests to be run periodically on a configured schedule.

Segment 75 May 18, 2022
An always-on framework that performs end-to-end functional network testing for reachability, latency, and packet loss

Arachne Arachne is a packet loss detection system and an underperforming path detection system. It provides fast and easy active end-to-end functional

Uber Open Source 367 Jun 17, 2022
BDD Testing Framework for Go

Jump to the docs | 中文文档 to learn more. To start rolling your Ginkgo tests now keep reading! If you have a question, comment, bug report, feature reque

Onsi Fakhouri 6k Jun 27, 2022
Framework of performance testing

Framework of performance testing fperf is a powerful and flexible framework which allows you to develop your own benchmark tools so much easy. You cre

null 338 Jun 16, 2022
Full-featured test framework for Go! Assertions, mocking, input testing, output capturing, and much more! 🍕

testza ?? Testza is like pizza for Go - you could life without it, but why should you? Get The Module | Documentation | Contributing | Code of Conduct

Marvin Wendt 389 Jun 18, 2022
espresso - a framework for testing BigQuery queries

espresso - a framework for testing BigQuery queries Goals Componentization: compose complex queries from smaller, reusable components Test driven deve

Tufin 5 Mar 14, 2022
Testy is a Go test running framework designed for Gametime's API testing needs.

template_library import "github.com/gametimesf/template_library" Overview Index Overview Package template_library is a template repository for buildin

Gametime United, Inc. 3 May 2, 2022
Fortio load testing library, command line tool, advanced echo server and web UI in go (golang). Allows to specify a set query-per-second load and record latency histograms and other useful stats.

Fortio Fortio (Φορτίο) started as, and is, Istio's load testing tool and now graduated to be its own project. Fortio is also used by, among others, Me

Fortio (Φορτίο) 2.6k Jun 24, 2022
:exclamation:Basic Assertion Library used along side native go testing, with building blocks for custom assertions

Package assert Package assert is a Basic Assertion library used along side native go testing Installation Use go get. go get github.com/go-playground/

Go Playgound 39 Apr 17, 2022
Expressive end-to-end HTTP API testing made easy in Go

baloo Expressive and versatile end-to-end HTTP API testing made easy in Go (golang), built on top of gentleman HTTP client toolkit. Take a look to the

Tom 725 May 12, 2022
Simple Go snapshot testing

Incredibly simple Go snapshot testing: cupaloy takes a snapshot of your test output and compares it to a snapshot committed alongside your tests. If t

Bradley Kemp 217 Jun 16, 2022
Clean database for testing, inspired by database_cleaner for Ruby

DbCleaner Clean database for testing, inspired by database_cleaner for Ruby. It uses flock syscall under the hood to make sure the test can runs in pa

Scott Le 140 Jun 28, 2022
Mutation testing for Go source code

go-mutesting go-mutesting is a framework for performing mutation testing on Go source code. Its main purpose is to find source code, which is not cove

Markus Zimmermann 536 Jun 22, 2022
Extremely flexible golang deep comparison, extends the go testing package and tests HTTP APIs

go-testdeep Extremely flexible golang deep comparison, extends the go testing package. Latest news Synopsis Description Installation Functions Availab

Maxime Soulé 303 Jun 19, 2022