[CST-2] Kolmogorov complexity - cost of sorting
Jonny Graham
jlg33@cam.ac.uk
Fri, 31 May 2002 14:06:36 +0100
Yes, We are trying to prove that we can't sort faster than nlogn for
arbitrary data.
nloglogn is faster than nlogn so yes, the argument (when fixed thanks to
James...) would work. But since we can't sort faster than nlogn, we
certainly can't sort faster than nloglogn anyway, so there's no problem.
The nlogn comes from the random permutation. Things can be arranged in
n! ways which basically gives us a Kolmogorov complexity of nlogn
(Stirling's approximation).
Jamie Shotton wrote:
> I seem to be missing something: What exactly are we trying to prove?
> That we can't sort faster than nlogn for arbitrary data? And in the
> argument below, what's to stop you substituting e.g. nloglogn for nlogn?
> AFAICS that makes no difference to the argument but gives a different
> result...?
>
> Puzzled Jamie
>
>
>>>Imagine we could create a program (constant Kolmogorov complexity)
>>>which sorts in less than nlog(n). Consider the *inverse* of this
>>>program (still constant) which takes a sorted list and
>>
>>outputs it in
>>
>>>the original random ordering in less than
>>>nlog(n)
>>>This would allow us to compress the original random
>>
>>permutation as the
>>
>>>sorted bits + progran(constant). But since it was a *random*
>>>permutation, it's uncompressible! Contradiction -- so we
>>
>>can't sort in
>>
>>>less than nlog(n).
>>>
>>>This ignores the size of the constant of the program, but it still
>>>works if you include that. (Basically, the program would need to be
>>>able to sort in <<nlog(n)-c)
>>
>
>
>
> _______________________________________________
> CST-2 mailing list
> CST-2@srcf.ucam.org
> http://www.srcf.ucam.org/mailman/listinfo/cst-2
--
Jonny Graham
01223 565 373
07753 841 971
Selwyn College
Grange Road
Cambridge
CB3 9DQ
--My email account will cease to exist on 15/7/02--
--My new email address is jonnygraham@cantab.net --