a tool for handling file uploads simple

Enes Furkan Olcay

Last update: Nov 30, 2022

Overview

baraka

a tool for handling file uploads for http servers

makes it easier to make operations with files from the http request.

Install
Simple Usage
Filtering Parts
Contribute
License

Install

go get github.com/xis/baraka/v2

Simple Usage

func main() {
	// create a parser
	parser := baraka.NewParser(baraka.ParserOptions{
		MaxFileSize:   5 << 20,
		MaxFileCount:  5,
		MaxParseCount: 5,
	})

	store := baraka.NewFileSystemStore("./files")

	router := gin.Default()
	router.POST("/upload", func(c *gin.Context) {
		// parsing
		request, err := parser.Parse(c.Request)
		if err != nil {
			fmt.Println(err)
		}

		// get the form
		images, err := request.GetForm("images")
		if err != nil {
			fmt.Println(err)
		}

		// saving
		for key, image := range images {
			err = store.Save("images", "image_"+strconv.Itoa(key), image)
			if err != nil {
				fmt.Println(err)
			}
		}
	})
	router.Run()
}

you can use baraka with the other http server libraries, just pass the http.Request to the parser.Parse function.

Filtering Parts

You can filter parts by their properties, like part's content type. Parser can inspect the part's bytes and detect the type of the part with the Inspector.

// create a parser
parser := baraka.NewParser(baraka.ParserOptions{
	MaxFileSize:   5 << 20,
	MaxFileCount:  5,
	MaxParseCount: 5,
})

// give parser an inspector
parser.SetInspector(baraka.NewDefaultInspector(512))
// give parser a filter
parser.SetFilter(baraka.NewExtensionFilter(".jpg"))

Now parser will inspect the each part and it will just return the jpeg ones from the Parse function. You can make your own Inspector and Filter.

Contribute

pull requests are welcome. please open an issue first to discuss what you would like to change.

please make sure to update tests as appropriate.

License

MIT

Abstract File Storage

afs - abstract file storage Please refer to CHANGELOG.md if you encounter breaking changes. Motivation Introduction Usage Matchers Content modifiers S

221 Dec 30, 2022

Bigfile -- a file transfer system that supports http, rpc and ftp protocol https://bigfile.site

Bigfile ———— a file transfer system that supports http, rpc and ftp protocol 简体中文 ∙ English Bigfile is a file transfer system, supports http, ftp and

238 Dec 31, 2022

Go file operations library chasing GNU APIs.

flop flop aims to make copying files easier in Go, and is modeled after GNU cp. Most administrators and engineers interact with GNU utilities every da

33 Nov 10, 2022

Read csv file from go using tags

go-csv-tag Read csv file from Go using tags The project is in maintenance mode. It is kept compatible with changes in the Go ecosystem but no new feat

101 Nov 16, 2022

File system event notification library on steroids.

notify Filesystem event notification library on steroids. (under active development) Documentation godoc.org/github.com/rjeczalik/notify Installation

788 Dec 31, 2022

Pluggable, extensible virtual file system for Go

vfs Package vfs provides a pluggable, extensible, and opinionated set of file system functionality for Go across a number of file system types such as

212 Jan 3, 2023

An epoll(7)-based file-descriptor multiplexer.

poller Package poller is a file-descriptor multiplexer. Download: go get github.com/npat-efault/poller Package poller is a file-descriptor multiplexer

107 Sep 25, 2022

QueryCSV enables you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to a CSV file

QueryCSV enable you to load CSV files and manipulate them using SQL queries then after you finish you can export the new values to CSV file

100 Dec 22, 2021

Goful is a CUI file manager written in Go.

Goful Goful is a CUI file manager written in Go. Works on cross-platform such as gnome-terminal and cmd.exe. Displays multiple windows and workspaces.

300 Dec 28, 2022

Comments

file slice blob upload
while(start < totalSize){ fd = new FormData(); xhr = new XMLHttpRequest(); xhr.open('POST',util.config.serviceUrl+'/test',false); blob = file.slice(start,end); fd.append('data',blob); xhr.send(fd); start = end; end = start + LENGTH; }

When the blob was uploaded by the front-end slice, the program did not run properly

[GIN] 2022/11/22 - 00:16:12 | 200 | 16.1792ms | 127.0.0.1 | POST "/test" form not found [GIN] 2022/11/22 - 00:16:12 | 200 | 17.023ms | 127.0.0.1 | POST "/test" form not found [GIN] 2022/11/22 - 00:16:12 | 200 | 15.1288ms | 127.0.0.1 | POST "/test" form not found [GIN] 2022/11/22 - 00:16:12 | 200 | 13.3188ms | 127.0.0.1 | POST "/test"
opened by nimei66 0

Implementation of the S3 Store

We can create a S3Store (or another name) like FileSystemStore in the saver.go file.

like,

package baraka

type S3Store struct {
    // specific settings
}

func NewS3Store(/* specific settings */) S3Store {
    return S3Store{
        // specific settings
    }
}

func (s S3Store) Save(path string, filename string, part *Part) error {
    // specific things to upload part's bytes to the s3
}

so, we can easily upload the files to the s3 with this implementation.

enhancement help wanted good first issue

opened by xis 0

Releases(v2.0.3)

v2.0.3(Aug 29, 2021)

Source code(tar.gz)
Source code(zip)
v2.0.2(Feb 4, 2021)

you can get parts with their form names now added Inspector added Filter removed filter function removed processor removed informer request's parts field is a map now removed Parser interface
Source code(tar.gz)
Source code(zip)
v2.0.1(Dec 4, 2020)

v2.0.1 same as v1.2.0, releasing v2 because of the pkg.go.dev cache issues. please use v2 not v1.
Source code(tar.gz)
Source code(zip)
v1.2.0(Dec 4, 2020)

code is now more meaningful added available slices mechanism to use remaining []byte from the filtered parts added MaxParseCount variable to limit parse loop filter function now gets a []byte as a parameter Storage removed Marshaler removed removed Header related things from parser.Parse function, added Part struct to access data easily added NewParser function, Options renamed to ParserOptions, Parse method removed from Options, Options struct not implements Parser anymore, parser implements Parser interface now, parser can be created with NewParser function, now using Part struct instead of Header, not using Parts struct anymore, now using Request struct.
Source code(tar.gz)
Source code(zip)
v1.1.1(Aug 13, 2020)

fixed saving without extensions added filtering what data to save with process.StoreWithout
Source code(tar.gz)
Source code(zip)
v1.1.0(Aug 11, 2020)
removed WithMultipartReader, WithParseMultipartForm options. library just uses multipart.Reader() now. added ParseButMax function, so you can set a maxFileSize and maxFileCount limit to parser. you can give prefixes when storing the file now.

process.Store("user_image_") // it will be like this in filesystem // user_image_1.jpg // user_image_2.png // user-image_3.whatever

process.Filenames() for getting names of files process.ContentTypes() for getting content types of files process.Length() for getting total count of files

// prints filenames fmt.Println(process.Filenames()) // prints total files count fmt.Println(process.Length()) // prints content types of files fmt.Println(process.ContentTypes())

new struct Options for all parsing purposes. new struct Parts for all file operations.
Source code(tar.gz)
Source code(zip)
v1.0.1(Jul 18, 2020)

added json extracting from request
Source code(tar.gz)
Source code(zip)
v1.0.0(Jul 15, 2020)

Source code(tar.gz)
Source code(zip)