adam-m
c3a2f3a13c
Preliminary version of large files string extraction support - no full hit navitation yet.
...
Also, some refactoring and cleanup of old keyword search code.
2012-05-14 17:37:27 -04:00
adam-m
2530da54e9
- Inbox concurrency improvements
...
- enable some additional info in log
2012-05-09 12:45:42 -04:00
adam-m
4b83eb949b
- add inbox message count
...
- add more stats to log
- improve postMessage() performance
- keyword search ingest: handle better task cancellation, which could have previously resulted in lost artifact if second to last search is cancelled due to the final post-commit search
2012-05-07 22:55:10 -04:00
adam-m
463acb26ea
synchronization relax adjustments for solr queries
2012-05-03 15:45:08 -04:00
adam-m
fed8d27e2c
Do not post indexing error messages to Inbox - will be enabled for dev version in the future
2012-05-02 12:07:13 -04:00
adam-m
0f394c6a15
fix ingest compile warning
2012-05-01 23:39:37 -04:00
adam-m
2dcc8121a0
-process files with mail extension normally with tika first
...
- fscontentstringstream tweak
2012-05-01 23:08:35 -04:00
adam-m
b55d9ad301
Set stream.contentType field in index request to Solr, if content type has been set for the stream - useful for string extraction and help by pass tika.
...
String stream: if eof encountered, handle case when temp buffer has some strings.
2012-05-01 16:15:51 -04:00
adam-m
ac4cc7c624
better variable names, fix typo in ascii test, use UTF8 charset in stream, move string stream class
2012-05-01 13:43:38 -04:00
adam-m
95097e16d9
Merge branch 'master' of https://github.com/sleuthkit/autopsy
2012-04-30 17:35:34 -04:00
adam-m
e60c3d65e2
Add manifest file to ingestible extensions.
...
Add a function that abstracts out the ingestible check.
2012-04-30 17:35:05 -04:00
adam-m
3588590c7f
Update header
2012-04-30 14:55:07 -04:00
adam-m
8e03df80a9
Supplement the stream conversion class with 2 default method implementations and comments
2012-04-30 14:54:21 -04:00
adam-m
54302c124d
Minor cleanup, update javadoc
2012-04-30 14:40:23 -04:00
adam-m
96838e4915
Adjust index solr timeout better with file size
2012-04-30 13:59:50 -04:00
adam-m
4a35278ab0
- ensure messages are cleared when case closed, even if exc thrown
...
- adjust logging levels in term query class
- additional adjustments to handle case closed sooner
2012-04-30 11:51:32 -04:00
adam-m
7e1b633be7
TSK-468 keyword search hang on certain content
...
TSK-429 Case closing exception handling
- better design of Solr server, better encapsulation to improve concurrency and error handling
- added timeout (30 mins by default, to be tweaked per file size) for file index operation
- implemented better solr server stop() (graceful, then brutal)
- added Solr restart in case of timeout, fixes issue when server instance is shot and does not respond. After restart, ingest continues on following files
- better exception/error handling and handling of case closing while keyword search threads are being shutdown, but still running
2012-04-27 17:53:41 -04:00
Dick Fickling
35be56d87a
Merge branch 'master' of github.com:sleuthkit/autopsy
2012-04-26 13:27:12 -04:00
Dick Fickling
3da17cddf0
Further build script change
2012-04-26 13:26:47 -04:00
adam-m
43a9c27c63
- tweaks to ingest disk space monitor
...
- keyword search index error message: add info if file is deleted
2012-04-26 12:19:12 -04:00
adam-m
4624a98c8c
Keyword search ingest - simplify timer - use Timer utility instead implementing own
2012-04-25 16:59:26 -04:00
adam-m
b6505785a2
Move class to keyword search module - it's only used there for now.
2012-04-25 10:06:06 -04:00
adam-m
ab93a84ae5
Move class to core utils
2012-04-25 10:03:15 -04:00
adam-m
22f4dbc7b4
Fix more compile warnings
2012-04-20 23:51:08 -04:00
adam-m
3bbde437e9
Merge branch 'master' of https://github.com/sleuthkit/autopsy
2012-04-20 23:42:03 -04:00
adam-m
f0db778dfd
Keyword search string extraction: use FsContentStringStream to convert to string on the fly using a fixed small buffer
2012-04-20 23:41:39 -04:00
adam-m
2af3d5f852
Merge branch 'master' of https://github.com/sleuthkit/autopsy
2012-04-19 18:04:39 -04:00
adam-m
50a044ad7c
Uses tika for DWG Autodesk file format, to workaround tika bug and prevent hanging state
2012-04-19 18:04:19 -04:00
adam-m
d9679138c6
Merge branch 'master' of https://github.com/sleuthkit/autopsy
2012-04-19 13:48:25 -04:00
adam-m
123e9b8e0f
change keyword search ingest logging info to warn when appropriate
2012-04-19 13:48:06 -04:00
Dick Fickling
97119a18d0
Keyword search: remove unnecessary dialog
2012-04-19 10:22:02 -04:00
adam-m
9b289272b9
add Platform util class, add method to get java path
2012-04-18 12:54:14 -04:00
adam-m
5fae04dbdb
Add file name to error message
2012-04-17 15:34:50 -04:00
adam-m
6f9b32e997
TSK-464 Create more inbox warning and error messages in ingest modules code
...
- keyword search / indexing
2012-04-17 13:14:46 -04:00
adam-m
78b70aa03a
Solr: detect java bin path at starttime
2012-04-13 10:40:37 -04:00
adam-m
a6a90ae5f0
Skip ingesting files with unalloc flag set for now - some of them cause Solr indexing to hang. Unalloc space and files will be addressed in future.
2012-04-09 16:30:35 -04:00
adam-m
55f77584f9
TSK-430 Remove Ingest complete dialog
...
Removed API to register for callback from service simplifying it
2012-04-05 16:12:06 -04:00
adam-m
e6cd5c4573
Keyword search: register bb writer worker also for single literal search, imrpove highlighting performance
2012-04-05 15:39:38 -04:00
adam-m
dd309abbe0
Keyword search: Remove obsolete less writeToBlackBoard() from interface, use only the more efficient method.
...
Better error handling of Solr errors.
2012-04-05 13:46:05 -04:00
adam-m
a2267f34f5
Keyword search (manual search): better handling of background threads writing to bb. Use swing worker with progress bar and stop all threads when Case is closed preventing exceptions from being thrown.
2012-04-05 13:00:20 -04:00
adam-m
e78134ca37
Single keyword search: make bb writes more efficient in a single background thread
2012-04-05 10:29:30 -04:00
adam-m
0d735e3413
Keyword search single regex search tweak
2012-04-04 21:39:04 -04:00
adam-m
abb2b513c2
Ingest message inbox: add right click action for copy, select all
...
Keyword search: single regex search fix for simplified api
2012-04-04 21:34:07 -04:00
adam-m
79aa163ecc
TSK-389 Change file read() API
...
- adapt to API change, optimize/reuse buffer when possible
2012-04-03 17:46:42 -04:00
adam-m
c92833bb47
Renable string extraction on up to 1MB strings
2012-04-02 14:41:26 -04:00
adam-m
e163c35b11
Keyword search remove performQueryPerTerm() from interface and simplify code
2012-04-02 14:24:29 -04:00
adam-m
74fdab0b08
TSK-424 Review Keyword Search Behavior
...
- fix non-regex queries inside outter quotes supplied by user (do not escape the quotes)
- do not force quotes for non-regex queryies and fix highlighting when query consists of multiple words
2012-03-30 13:55:41 -04:00
adam-m
a0d3364e3c
remove watch lists string reference
2012-03-30 10:36:54 -04:00
adam-m
ec5adde672
Catch all exceptions in CaseChangeListener, otherwise it would prohibit other handlers from running
2012-03-29 16:36:42 -04:00
Dick Fickling
d191b7de2a
Merge branch 'master' of github.com:sleuthkit/autopsy
2012-03-28 10:39:15 -04:00