35 Commits

Author SHA1 Message Date
Brian Carrier
948312fb33 Added basic file ingest module, 7ZIP and Exif skip more files 2013-08-12 11:04:05 -04:00
adam-m
3f1b81a4c3 Fix bug when free disk space during ingest cannot be detected as is reporting 0 (on some network file systems) and ingest is stopped 2013-07-28 15:13:41 -04:00
Brian Carrier
90a0acf1bf Updated IngestModule API to be abstract class instead of interface. Started to update docs. 2013-05-24 09:56:28 -04:00
adam-m
54932d9e9d handle .tar.gz case (and other) where inside archive file may have no path, then make up one. 2013-03-15 19:11:50 -04:00
adam-m
b24d4f8ec1 Handle the case when in-archive item is unknown 2013-03-15 15:44:06 -04:00
adam-m
9a03307533 zip and jpeg signature detection: do not log error if can't read the header and check file size first. 2013-03-05 09:16:55 -05:00
adam-m
c01f6077cd zip module add ZIP detection based on signature 2013-03-04 17:58:25 -05:00
adam-m
bfc213950a 7zip sends event when content added to refresh tree 2013-02-28 22:28:34 -05:00
adam-m
f635aa0d4d 7zip module tweak free disk space check 2013-02-26 10:45:05 -05:00
adam-m
ad3a884f56 7zip module tweaking 2013-02-25 15:06:11 -05:00
adam-m
38ce122917 Reimplemented zip bomb detection with depth count.
Better user messages when zip bomb.
2013-02-25 12:45:59 -05:00
adam-m
9c136f8e6f rename ingest context to pipeline context 2013-02-25 10:48:25 -05:00
adam-m
b3506b8ec0 rename progress bar, minor log additions 2013-02-22 18:55:35 -05:00
adam-m
f76b3d8086 7zip module add compression ratio check and free disk space check to help detect zip bomb.
Need to reimplement recursion depth check (removed for now)
2013-02-22 18:49:38 -05:00
adam-m
e6c936957d Better check if archive has already been processed to skip (besides children, check also if local file exists) 2013-02-21 10:48:51 -05:00
adam-m
98cd322134 add 7zip module reschedule unpacked files 2013-02-21 09:55:32 -05:00
adam-m
e1c9725364 change module display name and description 2013-02-21 09:46:11 -05:00
adam-m
a15a035565 add ingest context to ingest module process() method - API change.
Adjust all ingest modules.
Update ingest manager to create and pass in context.
2013-02-21 00:16:38 -05:00
adam-m
c6b287aa5d fix time conversion 2013-02-12 14:59:25 -05:00
adam-m
d5f1751679 update method names 2013-02-12 13:10:40 -05:00
adam-m
34aa1320e2 handle case when dates not set in archives 2013-02-12 13:02:46 -05:00
adam-m
571b9ae5ce add support to store mactimes with derived files and make 7zip module utilize it. 2013-02-12 12:55:07 -05:00
adam-m
25bad9ab08 add arj support, add placeholders for reschedule, send event, extract comments 2013-02-12 10:34:15 -05:00
adam-m
aa365d5095 Add user messages if archive error or archive encrypted 2013-02-11 21:37:56 -05:00
adam-m
316e466ce6 fix creating local files/dirs before extracting in some cases that would cause exceptions 2013-02-11 21:21:06 -05:00
adam-m
5786b50c9a set encryption type string based on if all or some files in archive encrypted 2013-02-11 21:05:51 -05:00
adam-m
07b0b6e869 handle the case when archive does not contain file parent directories 2013-02-11 20:57:30 -05:00
adam-m
fa935190ff new method to get all files from the tree to be scheduled 2013-02-08 17:04:17 -05:00
adam-m
85dcea971f implement method to get 1st level objects of unpacked tree 2013-02-08 12:28:03 -05:00
adam-m
e362d86b81 traverse hierarchy after unpacked and create derived files 2013-02-08 12:21:27 -05:00
adam-m
c7733e1c83 keep track of unpacked tree and not rely on order of files from 7zip lib 2013-02-08 10:01:23 -05:00
adam-m
095252cf0c prepend file name to local archive dir 2013-02-07 14:47:30 -05:00
adam-m
fa256a14d7 7zip module: add progress bar when unpacking, add bb artifact when archive is encrypted, fix unzip stream when EOF occurs 2013-02-07 14:44:18 -05:00
adam-m
07e13de21f initial sevenzip module - performs unpack of simple archives 2013-02-07 10:57:19 -05:00
adam-m
4a762b9bd2 initial 7zip ingest module skeleton with libs 2013-01-31 20:58:26 -05:00