how to use request module to download, and then upload file without intermediate file

Question

I want to download a image file to server first, then upload this file to other server.

If there is no download file step, it will be very simple

 var fs = require('fs');
 var path = '/tmp/test.png';
 var formData = {
   method: POST,
   url: 'http://127.0.0.1:3000',
   json: true,
   formData :{file: fs.createReadStream(path)}
 };
    request(formData, function(err, res, body){
   console.log("successful");
 });

However, for the situation with download image file;

I don't want to save the file first, through the format like request('http://google.com/doodle.png').pipe(fs.createWriteStream('doodle.png')). and then repeat fs.createReadStream.

Is there any method how can I get the file stream, so I can use the file stream directly to constitute formData;

isn't request already handling upload of a file stream - https://github.com/request/request#streaming ; fs.createReadStream('file.json').pipe(request.put('http://example.com/obj.json')) — Jerome WAGNER, Dec 07 '15 at 11:14
@JeromeWAGNER, yes, This is the step to handle file upload. I think 'file.json' should be a locale file. For my situation, I don't want to save a download file on the server, so there will not a file name. looking forward to your other advices. — ryu, Dec 07 '15 at 11:24
@ryu so following the reasoning provided, did you try `request(formData).pipe(request.put(...))`? — robertklep, Dec 07 '15 at 11:29
@robertklep, `request(formData).pipe(request.put(...))` should works. But in my issue, I think the point is how to get the file stream to process. I don't want to save file on the server, so I don't know how to do this except "fs.createReadStream" — ryu, Dec 07 '15 at 11:37

score 3 · Answer 1 · answered Dec 07 '15 at 11:53

3

This works for me:

var fs       = require('fs');
var request  = require('request');
var formData = {
  method   : 'POST',
  url      : 'http://127.0.0.1:3000',
  json     : true,
  formData : { file : request(downloadUrl) }
};

request(formData, function(err, res, body){
  if (err) throw err;
  console.log("successful");
});

answered Dec 07 '15 at 11:53

robertklep

198,204
35
394
381

1

This works for me too! Someone should add this method in their docs. Thanks! – wilsontgh Feb 14 '17 at 12:55

score 1 · Accepted Answer · answered Dec 07 '15 at 12:09

Following the request documentation, you can use

request.get(sourceUrl).pipe(request.post(targetUrl))

in this scheme, the data will flow from sourceUrl to targetUrl but will not need to be saved in a temporary file on the server.

cf https://github.com/request/request#streaming for more details.

how to use request module to download, and then upload file without intermediate file

2 Answers2

Linked

Related