Flux rss

Data compression

Why compress data?

Nowadays, the computing power of processors increases more quickly than storage capacities, and is much faster than network band-widths, because this requires enormous changes in the telecommunication infrastructures.
Thus, to compensate for this, it is usual to rather reduce the size of the data by exploiting the computing power of the processors rather than by increasing storage and data transmission capacities.

What is data compression?

Compression consists in reducing the physical size of information blocks. A compressor uses an algorithm which is used to optimize the data by using suitable considerations for the type as data to be compressed; a decompressor is thus necessary to reconstruct the original data using an algorithm that is the opposite to that used for compression.

The compression method depends intrinsically on the type of data to be compressed: an image will not be compressed in the same way as an audio file…

Compression characterization

Compression can be defined by the compression factor, that is, the number of bits in the compressed image divided by the number of bits in the original image.

The compression ratio, which is often used, is the inverse of the compression factor; it is usually expressed as a percentage.

Finally, the compression gain, also expressed as a percentage, is equivalent to 1 minus the compression ratio:

Types of compressions and methods

Physical and logical Compression

Physical compression acts directly on the data; it is thus a question of storing the redundant data from one bit pattern to another.
Logical compression on the other hand is carried out by a logical reasoning, substituting this information with equivalent information.

Symmetrical and asymmetrical Compression

In the case of symmetrical compression, the same method is used to compress and to decompress the data. The same amount of work is thus needed for each of these operations. It is this type of compression which is generally used in data transmission.

Asymmetrical compression requires more work to be done for one of the two operations, it is usual to seek algorithms for which compression is slower than decompression. Algorithms that perform compression faster than decompression may be necessary in the case of data files which are seldom accessed (for security reasons for example), because this creates compact files.

Lossy compression

Lossy compression, as opposed to lossless compression, eliminates some information in order to achieve the best possible compression ratio, while keeping a result which is as close as possible to the original data. It is the case, for example, of certain image or sound compressions, such as MP3 or the Ogg Vorbis format.

Since this type of compression removes information contained in the data that is to be compressed, it is usual to speak of irreversible compression methods.

Executable files, for example, cannot be compressed using this method, because they particularly need to preserve their integrity in order to be able to run. Indeed, it is not conceivable to roughly reconstruct a program by omitting bits and then adding some.

On the other hand, multimedia data (audio, video) can tolerate a certain level of degradation without the sensory organs (eye, tympanum, etc) distinguishing any significant degradation.

Adaptive, semi-adaptive and non-adaptive encoding

Certain compression algorithms are based on dictionaries that are for a specific type of data: these are non-adaptive encoders. The occurrence of letters in a text file, for example, depends on the language in which it is written.

An adaptive encoder adapts to the data which it will have to compress, it does not start out with an already prepared dictionary for a given type of data.

A semi-adaptive encoder will build a dictionary according to the data to be compressed: it builds the dictionary by going through the file and then compresses the latter.

Last update on Thursday October 16, 2008 02:43:16 PM.

This document entitled « Data compression  » from Kioskea (en.kioskea.net) is made available under the Creative Commons license. You can copy, modify copies of this page, under the conditions stipulated by the licence, as this note appears clearly.

Results for Data compression

MP3 MP3 ("MPEG Audio layer 3") is a lossy audio data compression format, developed by the International Organization for Standardization (ISO). This format is used to compress normal audio formats (WAV or CD audio) at a rate of 1:12. As mp3 files, the... en.kioskea.net/audio/mp3.php3
AAC (m4a) AAC (Audio Advanced Coding) is an audio data compression format developed by the Fraunhofer Institute in cooperation with AT, Nokia, Sony and Dolby. As with the MP3 format, it's a form of compression which removes some of the audio data, called... en.kioskea.net/audio/aac-m4a.php3
Ogg Vorbis Ogg Vorbis is an audio data compression format developed by Xiph.org. As with the MP3 format, it's a form of compression which reduces some of the audio data, called "lossy compression". This means eliminating some of the audio data (non-audible... en.kioskea.net/audio/ogg-vorbis.php3

Results for Data compression

Create and Open a RAR fileCreate and Open a RAR file How to create a RAR file How to open a RAR file RAR is an archive file format that is used during data compression, error recovery and file spanning. RAR is the acronym for Roshal Archive, inspired by the... en.kioskea.net/faq/sujet-143-create-and-open-a-rar-file
How to read a .DAA fileHow to open a .DAA file DAA is the acronym for Direct Access Archive and is used mainly for data compression and file splitting. Like .bin/.cue files, the .daa extension is an archive file format that can be used to divide a movie file into... en.kioskea.net/faq/sujet-302-how-to-read-a-daa-file
How to read a file .RAR?Winrar superNZB How to read a file .RAR? RAR is a data compression format developed by Roshal. This file format can be used for data recovery and file spanning. Winrar Winrar is the perfect tool for opening and decompressing .RAR... en.kioskea.net/faq/sujet-397-how-to-read-a-file-rar

Results for Data compression

MySQL Help, PHP and Database help (Solved)Hello, I am building a form/blog/personal site for a small company. I was wondering if someone could help me in setting up my database. i have thought of a few options but i am not quite sure what one is the best. each user have a person page, they... en.kioskea.net/forum/affich-21728-mysql-help-php-and-database-help
How to merge an excel file to database? (Solved)Could someone please instruct me how to merge an excel file to database (MS Access/FoxPro/Oracle)? en.kioskea.net/forum/affich-19483-how-to-merge-an-excel-file-to-database
Excel: Remove data to another sheetHello, I got a bit of an Excel query that I am struggling with. Say you have two worksheets - Data1 and Data2. Both sheets will have identical columns and column headings. But Data1 will be the main sheet where all the data is inputted to, save for... en.kioskea.net/forum/affich-14241-excel-remove-data-to-another-sheet

Results for Data compression

Download Swapper Swapper is a free software and in French for the exchange of heavy files such as a video or a music. His functioning is very simple, downloading is speed up by the automatic compression of data. Documents are stocked in a server, what allows to the... en.kioskea.net/telecharger/telecharger-137-swapper
Download Zilla Data NukerBy abolishing files or sensitive or contaminated files, it is possible that fragments stay on the hard disk. These rags can again harm your system if they are not correctly abolished. Zilla Data Nuker abolishes not used files which take of the place... en.kioskea.net/telecharger/telecharger-506-zilla-data-nuker
Download Database Designer Platinum EditionDatabase Designer is a program for creating databases. It requires no programming knowledge. The application offers many tools: additions of fields, images, checks bugs correction syntactic and much more. It also allows the export of basic HTML, text... en.kioskea.net/telecharger/telecharger-1077-database-designer-platinum-edition

Results for Data compression

Hacker splashes data from six million Chileans on Internet: reportFile photo shows the view from the San Cristobal hill overlooking the Chilean capital, Santiago. A hacker broke into Chile's government sites mining data from six million people which he then posted on the Internet A hacker broke into... en.kioskea.net/actualites/hacker-splashes-data-from-six-million-chileans-on-internet-report-10363-actualite.php3
Google hands over data on suspected pedophiles to BrazilThe website Orkut from Google is displayed on a screen in a cybercafe in Brasilia, on April 9. Google on Wednesday handed over data stored by suspected pedophiles on its Orkut social networking site to Brazilian authorities, ceding to pressure to... en.kioskea.net/actualites/google-hands-over-data-on-suspected-pedophiles-to-brazil-10315-actualite.php3
Facebook suffers first drop in British users: dataFacebook, the Internet social networking site, has suffered its first drop in British users in 17 months, according to data from web monitoring firm Nielsen Online. Facebook, the Internet social networking site, has suffered its first drop in British... en.kioskea.net/actualites/facebook-suffers-first-drop-in-british-users-data-10141-actualite.php3

Results for Data compression

Video and digital imaging- Video compression A non-compressed video image occupies approximately 1 MB. In order to obtain a fluid video, it is necessary to have a frequency of at least 25 or 30 images per second, which produces a data flow of approximately 30 MB/s, that is, more than 1.5 GB per... en.kioskea.net/video/compvid.php3
Data transmission - Introduction The purpose of a network is to transmit information from one computer to another. To do this, you first have to decide how to encode the data to be sent, in other words its computer representation. This will differ according to the type of data,... en.kioskea.net/transmission/transintro.php3
Data transmission - Cabling Several physical data-transmission media are available to connect together the various devices on a network. One possibility is to use cables. There are many types of cables, but the most common are: Coaxial cable Double twisted pair Optical fibre... en.kioskea.net/transmission/transcabl.php3