Upload a file larger than 800 GB

Dash Python
1

Hi

I’m currently working on a Dash project where users need to upload a csv file. The dash upload component supports only files smaller than 150 MB (I read somewhere). The files I need are around 800 MB up to 1GB.

Question 1: how can I solve this?

Question 2: When uploading works, how can I use the dataset on a multi Page App?

Kind regards, Sarah

2

Hi @Sarah.decock2,

I havent tried it, but i think this component should do for the upload,

Show And Tell -- Dash Resumable Upload

\emher

3

Thanks for the anwser!

Sorry for my late response. I have tried this before but still doesn’t work. When I tried the ‘npm run’ as described on the GitHub, I got the following error:
npm ERR! code ELIFECYCLE npm ERR! errno 1 npm ERR! active_learning_platform@1.0.0 start: builder run build-dev npm ERR! Exit status 1 npm ERR! npm ERR! Failed at the active_learning_platform@1.0.0 start script. npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

When just try to run the Dash app with ‘index.py’ in the command line, I got the following error:

caught Error: dash_resumable_upload was not found.

package.json

{
  "name": "active_learning_platform",
  "version": "1.0.0",
  "description": "",
  "main": "index.js",
  "scripts": {
    "test": "builder run check",
    "start": "builder run build-dev"
  },
  "author": "",
  "license": "ISC",
  "dependencies": {
    "builder": "3.2.2",
    "copyfiles": "^1.2.0",
    "dash-components-archetype": "^0.2.11",
    "prop-types": "^15.7.2",
    "react": "16.6.1",
    "resumablejs": "^1.1.0"
  },
  "devDependencies": {
    "dash-components-archetype-dev": "^0.2.11",
    "enzyme": "^2.8.2",
    "react-dom": "16.6.1",
    "react-test-renderer": "16.6.1"
  }
}

header.py (I work with a multipage app)

dash_resumable_upload.Upload(
                id='upload',
                service='/upload_resumable',
            )

app.py

app = dash.Dash(__name__, external_stylesheets=external_stylesheets)
dash_resumable_upload.decorate_server(app.server, 'uploads')

app.scripts.config.serve_locally = True
app.config.suppress_callback_exceptions = True

Is there something important that I did not do?

Thanks in advance

Kind regards,
Sarah De Cock

4

Hi — for those of you looking to upload large files, see:

Show And Tell – dash-uploader (Upload large files)