2964 Commits

Author SHA1 Message Date
adam-m
2214bcb1f5 Add synchronization around currentResults in a rare case of 2 searchers (first cancelled, but still running) 2012-05-17 12:48:40 -04:00
adam-m
708dbd63ee Merge branch 'master' into new-features-20120503
Conflicts:
	KeywordSearch/src/org/sleuthkit/autopsy/keywordsearch/KeywordSearchIngestService.java
2012-05-17 10:24:39 -04:00
adam-m
042b47b766 fix signature before merge 2012-05-17 10:21:33 -04:00
adam-m
9e2de4cb63 Catch cancellation exception in addition to checking for iscancelled 2012-05-17 10:17:33 -04:00
adam-m
d4affa5ef6 Keyword search ingest: handle final searcher case if thread cancel() is non-blocking operation
In done(), collect and log all exceptions thrown while in background
2012-05-17 10:09:37 -04:00
adam-m
acab96de5c Keyword search chunks: faster generating preview from dir tree, by quering only the content id of interest. Added support to filter query by id to keyword search API. 2012-05-16 17:28:44 -04:00
adam-m
4d5fdcd31f Update page nav code 2012-05-16 15:06:35 -04:00
adam-m
1658103e9e Fix for getting correct # of pages to display 2012-05-16 14:34:17 -04:00
adam-m
2111361cea Remove comment, update text 2012-05-16 11:09:30 -04:00
adam-m
0d20d22808 Keyword search: hit navigation now spans all pages that have hits 2012-05-16 10:57:23 -04:00
adam-m
945cfcdfb1 Page/hit navigation fix for special case 2012-05-16 10:15:52 -04:00
adam-m
fee9f9d0b1 Keyword search large strings: improvements in navigation, added support for chunk hit preview in dir tree (still needs optimizations) 2012-05-15 21:16:59 -04:00
adam-m
9164551f2a Keyword search: preliminary hit navigation for large files 2012-05-15 18:17:42 -04:00
adam-m
b897ac4f42 Merge branch 'master' into new-features-20120503
Conflicts:
	KeywordSearch/src/org/sleuthkit/autopsy/keywordsearch/KeywordSearchIngestService.java
2012-05-15 10:37:26 -04:00
adam-m
bf645bc9bb Keyword search: unify result viewers and remove the old single non-regex result viewer. Keeping the code for now, but will remove in future (will simplify keyword search code greatly) 2012-05-14 18:03:57 -04:00
adam-m
c3a2f3a13c Preliminary version of large files string extraction support - no full hit navitation yet.
Also, some refactoring and cleanup of old keyword search code.
2012-05-14 17:37:27 -04:00
adam-m
2530da54e9 - Inbox concurrency improvements
- enable some additional info in log
2012-05-09 12:45:42 -04:00
adam-m
4b83eb949b - add inbox message count
- add more stats to log
- improve postMessage() performance
- keyword search ingest: handle better task cancellation, which could have previously resulted in lost artifact if second to last search is cancelled due to the final post-commit search
2012-05-07 22:55:10 -04:00
adam-m
463acb26ea synchronization relax adjustments for solr queries 2012-05-03 15:45:08 -04:00
adam-m
fed8d27e2c Do not post indexing error messages to Inbox - will be enabled for dev version in the future 2012-05-02 12:07:13 -04:00
adam-m
0f394c6a15 fix ingest compile warning 2012-05-01 23:39:37 -04:00
adam-m
2dcc8121a0 -process files with mail extension normally with tika first
- fscontentstringstream tweak
2012-05-01 23:08:35 -04:00
adam-m
b55d9ad301 Set stream.contentType field in index request to Solr, if content type has been set for the stream - useful for string extraction and help by pass tika.
String stream: if eof encountered, handle case when temp buffer has some strings.
2012-05-01 16:15:51 -04:00
adam-m
ac4cc7c624 better variable names, fix typo in ascii test, use UTF8 charset in stream, move string stream class 2012-05-01 13:43:38 -04:00
adam-m
95097e16d9 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-30 17:35:34 -04:00
adam-m
e60c3d65e2 Add manifest file to ingestible extensions.
Add a function that abstracts out the ingestible check.
2012-04-30 17:35:05 -04:00
adam-m
3588590c7f Update header 2012-04-30 14:55:07 -04:00
adam-m
8e03df80a9 Supplement the stream conversion class with 2 default method implementations and comments 2012-04-30 14:54:21 -04:00
adam-m
54302c124d Minor cleanup, update javadoc 2012-04-30 14:40:23 -04:00
adam-m
96838e4915 Adjust index solr timeout better with file size 2012-04-30 13:59:50 -04:00
adam-m
4a35278ab0 - ensure messages are cleared when case closed, even if exc thrown
- adjust logging levels in term query class
- additional adjustments to handle case closed sooner
2012-04-30 11:51:32 -04:00
adam-m
7e1b633be7 TSK-468 keyword search hang on certain content
TSK-429 	Case closing exception handling
- better design of Solr server, better encapsulation to improve concurrency and error handling
- added timeout (30 mins by default, to be tweaked per file size) for file index operation
- implemented better solr server stop() (graceful, then brutal)
- added Solr restart in case of timeout, fixes issue when server instance is shot and does not respond.  After restart, ingest continues on following files
- better exception/error handling and handling of case closing while keyword search threads are being shutdown, but still running
2012-04-27 17:53:41 -04:00
Dick Fickling
35be56d87a Merge branch 'master' of github.com:sleuthkit/autopsy 2012-04-26 13:27:12 -04:00
Dick Fickling
3da17cddf0 Further build script change 2012-04-26 13:26:47 -04:00
adam-m
43a9c27c63 - tweaks to ingest disk space monitor
- keyword search index error message: add info if file is deleted
2012-04-26 12:19:12 -04:00
adam-m
4624a98c8c Keyword search ingest - simplify timer - use Timer utility instead implementing own 2012-04-25 16:59:26 -04:00
adam-m
b6505785a2 Move class to keyword search module - it's only used there for now. 2012-04-25 10:06:06 -04:00
adam-m
ab93a84ae5 Move class to core utils 2012-04-25 10:03:15 -04:00
adam-m
22f4dbc7b4 Fix more compile warnings 2012-04-20 23:51:08 -04:00
adam-m
3bbde437e9 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-20 23:42:03 -04:00
adam-m
f0db778dfd Keyword search string extraction: use FsContentStringStream to convert to string on the fly using a fixed small buffer 2012-04-20 23:41:39 -04:00
adam-m
2af3d5f852 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-19 18:04:39 -04:00
adam-m
50a044ad7c Uses tika for DWG Autodesk file format, to workaround tika bug and prevent hanging state 2012-04-19 18:04:19 -04:00
adam-m
d9679138c6 Merge branch 'master' of https://github.com/sleuthkit/autopsy 2012-04-19 13:48:25 -04:00
adam-m
123e9b8e0f change keyword search ingest logging info to warn when appropriate 2012-04-19 13:48:06 -04:00
Dick Fickling
97119a18d0 Keyword search: remove unnecessary dialog 2012-04-19 10:22:02 -04:00
adam-m
9b289272b9 add Platform util class, add method to get java path 2012-04-18 12:54:14 -04:00
adam-m
5fae04dbdb Add file name to error message 2012-04-17 15:34:50 -04:00
adam-m
6f9b32e997 TSK-464 Create more inbox warning and error messages in ingest modules code
- keyword search / indexing
2012-04-17 13:14:46 -04:00
adam-m
78b70aa03a Solr: detect java bin path at starttime 2012-04-13 10:40:37 -04:00