BibSonomy bookmarks for /concept/tag/duplicate

Nobody knows technical fouls better than Ron Artest, period. You can probably make an argument for Rasheed or Malone but no one took it to another level than

Duplication Reduction Processors - Heritrix - IA Webteam Confluence

jaeschke — 2013-07-10T11:32:55+02:00

https://webarchive.jira.com/wiki/display/Heritrix/Duplication+Reduction+Processors

Skip duplicate entries in a slave « Random Thoughts

nosebrain — 2012-12-10T17:56:53+01:00

The following one liner helps to sync a slave that is facing duplicate entry errors. while [ 1 ]; do …Continue reading »

find and delete hard links, best duplicate file finder, duplicate file finder, picture duplicate finder, find duplicate mp3, freeware duplicate, find duplicate pictures, duplicate photo, search for duplicate files, delete duplicate files, duplicate picture

gresch — 2011-07-27T12:08:28+02:00

AllDup is a freeware tool for searching and removing file duplicates on your computer. The fast search algorithm find duplicates of any file type, e.g., text, pictures, music or movies. The powerful search engine enables you to find duplicates with a combination of the following criteria: File Name, File Extension, File Size, File Content, Last Modified Date, Create Date, File Attributes and Hard Links Features Freeware for private and commercial use Fast search algorithm Find duplicates with a combination of the following criteria: file content, file name, file extension, file dates and file attributes! Search is performed in multiple specified folders, drives, media storages, CD/DVDs, network drives... Search through an unlimited number of files and folders Search for duplicates of music and video files Search for duplicates of digital photo files Search for duplicates of executable and any other files Search for hard links Entire folders or individual files can be excluded from the search by masks or size conditions The built-in file viewer allows you to preview many different file formats and analyze the content of the file before deciding what to do with it Ignore the ID3 tags of MP3 files Convenient search result list Many flexible options help you to select unnecessary duplicates automatically The unnecessary duplicates can be deleted permanently or copied/moved to a folder of your choice Save and restore the search result for continue working later Export the search result to TXT or CSV file Turn duplicate files into hard links (NTFS file systems only) or shortcuts Detailed log file about all actions System Requirements Microsoft Windows 7 (all versions) Microsoft Windows Server 2008 (all versions) Microsoft Windows Vista (all versions) Microsoft Windows Server 2003 (all versions) Microsoft Windows XP (all versions) * Microsoft Windows 2000 (all versions) * AllDup also runs on the 64-bit versions of these operating systems. * The portable version of AllDup doesn't support Windows XP without any Service Pack installed and Microsoft Windows 2000.

dupeGuru - Duplicate file scanner

gresch — 2011-07-27T12:07:40+02:00

dupeGuru is a tool to find duplicate files on your computer. It can scan either filenames or contents. The filename scan features a fuzzy matching algorithm that can find duplicate filenames even when they are not exactly the same. dupeGuru runs on Windows, Mac OS X and Linux. dupeGuru is efficient. Find your duplicate files in minutes, thanks to its quick fuzzy matching algorithm. dupeGuru not only finds filenames that are the same, but it also finds similar filenames. dupeGuru is customizable. You can tweak its matching engine to find exactly the kind of duplicates you want to find. The Preference page of the help file lists all the scanning engine settings you can change. dupeGuru is safe. Its engine has been especially designed with safety in mind. Its reference directory system as well as its grouping system prevent you from deleting files you didn't mean to delete. Do whatever you want with your duplicates. Not only can you delete duplicates files dupeGuru finds, but you can also move or copy them elsewhere. There are also multiple ways to filter and sort your results to easily weed out false duplicates (for low threshold scans). Supported languages: English, French. Requirements Mac OS X: 10.5 and up (Leopard, Snow Leopard or Lion). PowerPC or Intel. (Last version to support Tiger: v2.8.2) Windows: 2k/XP/Vista/Win7. Linux: Ubuntu 10.04

DuplicatesFilter - one for contrib? | Lucene | Java-Dev

folke — 2011-07-25T18:00:12+02:00

http://www.gossamer-threads.com/lists/lucene/java-dev/53351

Deduplication - Solr Wiki

stroeh — 2011-06-29T12:37:29+02:00

http://wiki.apache.org/solr/Deduplication

Bibliographic Hash Key – Verbund-Wiki GBV

stroeh — 2011-06-27T08:55:59+02:00

http://www.gbv.de/wikis/cls/Bibliographic_Hash_Key

Duplicate Files Finder | Download Duplicate Files Finder software for free at SourceForge.net

gresch — 2011-05-27T09:34:41+02:00

Duplicate Files Finder is a cross-platform application for finding and removing duplicate files by deleting, creating hardlinks or creating symbolic links. A special algorithm minimizes the amount of data read from disk, so the program is very fast.

Duplicate File Eraser

gresch — 2011-05-27T09:33:54+02:00

Duplicate File Eraser findet und entfernt Duplikate. Duplikate sind mehrfach vorkommende identische Dateien und belegen oftmals unnötigen Speicherplatz, der mit diesem Programm wieder freigegeben werden kann. Die Duplikate werden mittels MD5, CRC32 oder SHA1 ermittelt, und können anschliessend gelöscht werden.

FSlint - Duplicate file finder for linux

gresch — 2011-05-27T09:31:13+02:00

FSlint is a utility to find and clean various forms of lint on a filesystem. I.E. unwanted or problematic cruft in your files or file names. For example, one form of lint it finds is duplicate files. It has both GUI and command line modes.

Duplicate Files Searcher - Das Tool zur Suche nach doppelten Dateien, findet und löscht Duplikate von Dateien im Computer.

gresch — 2011-05-27T09:28:28+02:00

Was ist DFS – DuplicateFiles Seracher - Das Tool zur Suche nach doppelten Dateien? DFS – Duplicate Files Seracher - Das Tool zur Suche nach doppelten Dateien findet und löscht Duplikate von Dateien im Computer. Es kann aber auch benutzt werden, um MD5 oder SHA Hashes zu berechnen. Es sind zwei Versionen verfügbar die open source – Version. Die Version open source befindet sich in der Datei dfs.jar die voll version (unentgeltlich, aber nicht open source). Die Vollversion ist zugänglich als Datei mit dem Namen dfsfull.jar.

Near-duplicates and shingling

stroeh — 2011-03-09T13:51:35+01:00

can now generate all pairs $i,j$ for which $x_i^\pi$ is present in both their sketches. From these we can compute, for each pair $i,j$ with non-zero sketch overlap, a count of the number of $x_i^\pi$ values they have in common. By applying a preset threshold, we know which pairs $i,j$ have heavily overlapping sketches. For instance, if the threshold were 80%, we would need the count to be at least 160 for any $i,j$. As we identify such pairs, we run the union-find to group documents into near-duplicate ``syntactic clusters''. This is essentially a variant of the single-link clustering algorithm introduced in Section 17.2 (page [*]).

w-shingling - Wikipedia, the free encyclopedia

stroeh — 2011-03-09T12:57:28+01:00

http://en.wikipedia.org/wiki/W-shingling