1 min read

Uploading and downloading some files to S3 via S3-file-uploader with ECS containers.

GitHub is here!!

background

Web application proxying S3 access because my company proxy prohibits S3 access(OMG).

The features of this system are as follows.

  • Never using PUT or Delete HTTP methods because of prohibits to my company's proxy
  • compress GZip before upload file because of prohibits large file for my company's proxy.
  • List S3 files.
  • HTTP Basic Authentication.

With AWS ECS

Example log-uploader archtecture with AWS ECS(Fargate)

img

Install

Precondition

  • Node.js (more v10.15.x)
  • Go (more 11.1)
  • Docker(If you use)

Install dependencies

make backend-install
make front-install

Set your environment

  • Fix front config for your environment to refer sample.json
  • Fix backend config for your environment to refer sample.toml

If you create dev config, set dev.json, dev.toml for 2 config name.

Build

make front-build ENV=foo
make backend-build END=foo

Usage

Run local

make backend-run ENV=foo

Use Docker

make docker-build ENV=foo

Demo

Upload File

img

List S3 files

img