799 Commits

Author SHA1 Message Date
adam-m
c3a2f3a13c Preliminary version of large files string extraction support - no full hit navitation yet.
Also, some refactoring and cleanup of old keyword search code.
2012-05-14 17:37:27 -04:00
adam-m
2530da54e9 - Inbox concurrency improvements
- enable some additional info in log
2012-05-09 12:45:42 -04:00
adam-m
4b83eb949b - add inbox message count
- add more stats to log
- improve postMessage() performance
- keyword search ingest: handle better task cancellation, which could have previously resulted in lost artifact if second to last search is cancelled due to the final post-commit search
2012-05-07 22:55:10 -04:00
adam-m
463acb26ea synchronization relax adjustments for solr queries 2012-05-03 15:45:08 -04:00
adam-m
fed8d27e2c Do not post indexing error messages to Inbox - will be enabled for dev version in the future 2012-05-02 12:07:13 -04:00
adam-m
0f394c6a15 fix ingest compile warning 2012-05-01 23:39:37 -04:00
adam-m
2dcc8121a0 -process files with mail extension normally with tika first
- fscontentstringstream tweak
2012-05-01 23:08:35 -04:00
adam-m
b55d9ad301 Set stream.contentType field in index request to Solr, if content type has been set for the stream - useful for string extraction and help by pass tika.
String stream: if eof encountered, handle case when temp buffer has some strings.
2012-05-01 16:15:51 -04:00
adam-m
ac4cc7c624 better variable names, fix typo in ascii test, use UTF8 charset in stream, move string stream class 2012-05-01 13:43:38 -04:00
adam-m
95097e16d9 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-30 17:35:34 -04:00
adam-m
e60c3d65e2 Add manifest file to ingestible extensions.
Add a function that abstracts out the ingestible check.
2012-04-30 17:35:05 -04:00
adam-m
3588590c7f Update header 2012-04-30 14:55:07 -04:00
adam-m
8e03df80a9 Supplement the stream conversion class with 2 default method implementations and comments 2012-04-30 14:54:21 -04:00
adam-m
54302c124d Minor cleanup, update javadoc 2012-04-30 14:40:23 -04:00
adam-m
96838e4915 Adjust index solr timeout better with file size 2012-04-30 13:59:50 -04:00
adam-m
4a35278ab0 - ensure messages are cleared when case closed, even if exc thrown
- adjust logging levels in term query class
- additional adjustments to handle case closed sooner
2012-04-30 11:51:32 -04:00
adam-m
7e1b633be7 TSK-468 keyword search hang on certain content
TSK-429 	Case closing exception handling
- better design of Solr server, better encapsulation to improve concurrency and error handling
- added timeout (30 mins by default, to be tweaked per file size) for file index operation
- implemented better solr server stop() (graceful, then brutal)
- added Solr restart in case of timeout, fixes issue when server instance is shot and does not respond.  After restart, ingest continues on following files
- better exception/error handling and handling of case closing while keyword search threads are being shutdown, but still running
2012-04-27 17:53:41 -04:00
Dick Fickling
35be56d87a Merge branch 'master' of github.com:sleuthkit/autopsy 2012-04-26 13:27:12 -04:00
Dick Fickling
3da17cddf0 Further build script change 2012-04-26 13:26:47 -04:00
adam-m
43a9c27c63 - tweaks to ingest disk space monitor
- keyword search index error message: add info if file is deleted
2012-04-26 12:19:12 -04:00
adam-m
4624a98c8c Keyword search ingest - simplify timer - use Timer utility instead implementing own 2012-04-25 16:59:26 -04:00
adam-m
b6505785a2 Move class to keyword search module - it's only used there for now. 2012-04-25 10:06:06 -04:00
adam-m
ab93a84ae5 Move class to core utils 2012-04-25 10:03:15 -04:00
adam-m
22f4dbc7b4 Fix more compile warnings 2012-04-20 23:51:08 -04:00
adam-m
3bbde437e9 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-20 23:42:03 -04:00
adam-m
f0db778dfd Keyword search string extraction: use FsContentStringStream to convert to string on the fly using a fixed small buffer 2012-04-20 23:41:39 -04:00
adam-m
2af3d5f852 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-19 18:04:39 -04:00
adam-m
50a044ad7c Uses tika for DWG Autodesk file format, to workaround tika bug and prevent hanging state 2012-04-19 18:04:19 -04:00
adam-m
d9679138c6 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-19 13:48:25 -04:00
adam-m
123e9b8e0f change keyword search ingest logging info to warn when appropriate 2012-04-19 13:48:06 -04:00
Dick Fickling
97119a18d0 Keyword search: remove unnecessary dialog 2012-04-19 10:22:02 -04:00
adam-m
9b289272b9 add Platform util class, add method to get java path 2012-04-18 12:54:14 -04:00
adam-m
5fae04dbdb Add file name to error message 2012-04-17 15:34:50 -04:00
adam-m
6f9b32e997 TSK-464 Create more inbox warning and error messages in ingest modules code
- keyword search / indexing
2012-04-17 13:14:46 -04:00
adam-m
78b70aa03a Solr: detect java bin path at starttime 2012-04-13 10:40:37 -04:00
adam-m
a6a90ae5f0 Skip ingesting files with unalloc flag set for now - some of them cause Solr indexing to hang. Unalloc space and files will be addressed in future. 2012-04-09 16:30:35 -04:00
adam-m
55f77584f9 TSK-430 Remove Ingest complete dialog
Removed API to register for callback from service simplifying it
2012-04-05 16:12:06 -04:00
adam-m
e6cd5c4573 Keyword search: register bb writer worker also for single literal search, imrpove highlighting performance 2012-04-05 15:39:38 -04:00
adam-m
dd309abbe0 Keyword search: Remove obsolete less writeToBlackBoard() from interface, use only the more efficient method.
Better error handling of Solr errors.
2012-04-05 13:46:05 -04:00
adam-m
a2267f34f5 Keyword search (manual search): better handling of background threads writing to bb. Use swing worker with progress bar and stop all threads when Case is closed preventing exceptions from being thrown. 2012-04-05 13:00:20 -04:00
adam-m
e78134ca37 Single keyword search: make bb writes more efficient in a single background thread 2012-04-05 10:29:30 -04:00
adam-m
0d735e3413 Keyword search single regex search tweak 2012-04-04 21:39:04 -04:00
adam-m
abb2b513c2 Ingest message inbox: add right click action for copy, select all
Keyword search: single regex search fix for simplified api
2012-04-04 21:34:07 -04:00
adam-m
79aa163ecc TSK-389 Change file read() API
- adapt to API change, optimize/reuse buffer when possible
2012-04-03 17:46:42 -04:00
adam-m
c92833bb47 Renable string extraction on up to 1MB strings 2012-04-02 14:41:26 -04:00
adam-m
e163c35b11 Keyword search remove performQueryPerTerm() from interface and simplify code 2012-04-02 14:24:29 -04:00
adam-m
74fdab0b08 TSK-424 Review Keyword Search Behavior
- fix non-regex queries inside outter quotes supplied by user (do not escape the quotes)
- do not force quotes for non-regex queryies and fix highlighting when query consists of multiple words
2012-03-30 13:55:41 -04:00
adam-m
a0d3364e3c remove watch lists string reference 2012-03-30 10:36:54 -04:00
adam-m
ec5adde672 Catch all exceptions in CaseChangeListener, otherwise it would prohibit other handlers from running 2012-03-29 16:36:42 -04:00
Dick Fickling
d191b7de2a Merge branch 'master' of github.com:sleuthkit/autopsy 2012-03-28 10:39:15 -04:00