Slow file copier.

whizbang · 01-11-2016 9:26pm #1

All my internet searches come up as file copier too slow...

I need a small program that will copy files Slowly.
I mean one at a time, maybe 1 per second, or that kind of speed.

Basically i have a program that will import the data from the old files, and delete them as they are processed.
it has to run in the background, without hogging resources in use.

File sizes are approx 1Mb, and there is about 100,000 of them.

i did find one previously, but it couldn't handle the destination files being deleted by the import process.

thanks

golfcaptain · 02-11-2016 6:16am

whizbang wrote: »

All my internet searches come up as file copier too slow...

I need a small program that will copy files Slowly.
I mean one at a time, maybe 1 per second, or that kind of speed.

Basically i have a program that will import the data from the old files, and delete them as they are processed.
it has to run in the background, without hogging resources in use.

File sizes are approx 1Mb, and there is about 100,000 of them.

i did find one previously, but it couldn't handle the destination files being deleted by the import process.

thanks

It might be too early so forgive me but what is it you're trying to do? You have an existing program to import data from 100,000 1MB files and then delete them; where does the copying fit in?

whizbang · 03-11-2016 2:05am

Apologies, The new server will pick off the files as they arrive into its temp import folder.

If i dump all files at once, the host will clog up and crash, so the only way i can figure it, is to copy the files from current storage to the temp folder at a slow enough rate to allow new server to work away without killing it.

The old files will be archived off once imported, but need to be kept for verification etc.

Fysh · 03-11-2016 10:53am

Not aware of anything that does exactly what you need, but you could probably do something with a recurring scheduled task and a script.

Heck, even something like this would cover the basics:

$list=Get-child item <path containing files>
Foreach ($file in $list) {
    Copy-Item -path $file.Filepath -Destination <destination path>
    Start-Sleep 1
}

But if you need the tool to clean up after itself (e.g. delete files after they have been imported) or deal with othrr possible issues like checking available space at the destination, it gets more complicated.