Video duplicate detector archive#

Iif the bitrate is greater the average its 1 else its 0. then we would only analyze a portion of the video). Then I would look at the bitrate at certain points of time (percentage of the video completed or absolute seconds. I would transcode the video into a vbr videofile with the exact same settings.

developement of the bitrate over time with the same vbr codec.

So I get a binary string which I can store into mysql and do a boolean bit-sum (supported by mysql internally) and count the remaining uneval bits (as well supported internally, that would then be the Levenshtein distance of the bianry strings) I would resample the picture to a thumbnail size and get the average rgb values then serialize pixel by pixel if the color at this pixel is greater/smaller than the average represented by 0 or 1. So if it helps I can convert the video 100 times as well. I don't care the effort to create the metadata, I have enough slaves to do that. So now my question is what layers can you guys think of or do you have a better approach? So as I have a community to verify the results it suffices to deliver 'good guesses' with a low miss ratio. Unfortunately the better the comparision the more cpu and memory intensive it gets so I plan on implementing several layers of comparision that begin with very graceful but fast comparision (maby video lengh with a tolerance of 10%) and end with the final comparision that decides whether its really a duplicate (that would be a community vote). Or are cut off at the beginning and/or end. They can have different quality, are amby cropped, watermarked or have a sequel/prequel. Problem is the videos aren't exact duplicates. Now I need some sort of procedure where I index metadata in a database, and whenever a new video enters the catalog the same data is calculated and matched against in the database. With every video file I have associated semantic and descriptive information which I want to merge duplicates to achive better results for every one. The export can be done for the complete result or solely for the excluded files and can come in handy when you decide to organize your music collection.Īll in all, Video Duplicate Finder is a straightforward utility that provides a simple and straightforward way to detect dupes and delete the obsolete ones so you can gain more space on your system.I got a project having a catalog of currently some ten thousand video files, the number is going to increase dramatically. In case you want to create a list with the videos you have in your collection, then the program enables you to export the results to a CSV file for easier manipulation.

Allows you to export the database videos to CSV

You can delete the dupes, but you can also just remove the selected files from the list, copy to a new folder or save them as HTML. Despite the name of the application, it is very capable of identifying duplicate images as well.įollowing the scan, you can access the selection tool and specify which files you prefer to keep. You can get started by adding the folders that you want to be scanned for duplicates and specify if you want to exclude subfolders, the read-only directories or images. The interface consists of a two tabs window, one where you can access the settings and preview the results and another that acts as the log.

Video duplicate detector archive#

The app does not require installation, but rather you can decompress the archive in the desired location on your drive. Include the folder to be scanned and start the analysis What makes the app stand out is the fact that it also accounts for duplicates with different resolution, frame rate and even watermarked. Then again, things do not have to get complicated if you have the proper tools.Īs the name suggests, Video Duplicate Finder is a tool dedicated to identifying duplicate multimedia files and images using a similarity algorithm. Finding and erasing dupes from your computer is amongst the most hectic and time-consuming task to account for when trying to gain more space.