Login | Register
My pages Projects Community openCollabNet

Discussions > dev [DISABLED] > [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help)

subversion
Discussion topic

Back to topic list

[PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help)

Author chemodax
Full name deleted
Date 2007-06-30 14:45:41 PDT
Message On 6/30/07, Mark Phippard <markphip at gmail dot com> wrote:
> On 6/30/07, D.J. Heap <djheap at gmail dot com> wrote:
> > On 6/5/07, eg <egoots at gmail dot com> wrote:
> > > Mark Phippard wrote:
> > >
> > > >
> > > > Even in his objection Brane said "if this is true". All I (and
> > > > Stefan) am saying is we need a more specific objection. If there are
> > > > real problems that we cannot resolve, then I am sure we would all be
> > > > against this. But we know there are problems with apr_iconv too, so
> > > > let's just understand what the problems are.
> > > >
> > >
> > > In an attempt to help here, I have done a bit of hunting around to see
> > > if I could substantiate any publicly reported issues. I have mentioned
> > > the few that I have found in other posts. Stefan has already responded
> > > that these should not be issues for Subversion.
> > >
> > > The only other thing I could find for utf8 conversion, relates to
> > > handling of "bad inputs" related to lone surrogate halves when passing
> > > them to WideCharToMultiByte() on older versions of Windows (alluded to
> > > in blog comments from:
> > > http://blogs.msdn.co​m/michkap/archive/20​06/01/20/515238.aspx​).
> > > Apparently this is tightened up now (on Vista?).
> > >
> > > I suspect this is also not an issue for this usage in any case, but
> > > someone else more familiar with svn usage should confirm that.
> > >
> > > If there are any issues related to using Win32
> > > MultiByteToWideChar(​)/WideCharToMultiByt​e() in place of iconv() under
> > > Windows, I cannot find them. Older versions of Windows (95/98/Me) will
> > > need to install and use the MSLU (Microsoft Layer for unicode).
> >
> >
> > So, I have not been following along very carefully, but what needs to
> > happen now? Do a build and have people using different languages test
> > it?
> >
> > I can apply the patch and build the binary zips if other people have
> > the means to test them out a bit.
> >
> > Or is there something else that needs to be done?
>
> Does the test suite have any tests that exercise this?
>
> Ivan had said he was going to look into it, but I do not think he has.
> Ideally, I think someone should put together the patch that they
> think works completely and just commit it. Then we can bang on it and
> see if there are issues.
>
Sorry, I was busy and I have not time to report my research results.

My patch almost complete and I need somebody's eyes to look and
confirm that I'm on right way (or say that I'm on wrong way :)

I used Windows MIME database to convert page name to Windows page identifier.
And most important question is it acceptable to read Windows MIME
database directly from registry instead of using MLang API [1]? I
didn't use MLang API, because it requires
CoInitialize()/CoUni​nitialize().

Other notes:
- Probably this new win32_xlate stuff should go to separate file?
- For present time charset aliases isn't implemented.

[1] http://msdn2.microso​ft.com/En-US/library​/aa767865.aspx

[[[
!! This patch is NOT complete. !!!

Remove APR ICONV dependency on Windows and use native Windows
character conversion API (MultiByteToWideChar​/WideCharToMultiByte​).

* subversion/tests/lib​svn_subr/utf-test.c
  (test_utf_cstring_to_utf8_ex2): New test for conversion from
different codepages to utf8.
  (test_utf_cstring_fr​om_utf8_ex2): New test for conversion to
different codepages from utf8.
  (test_funcs): Add two tests.

* subversion/libsvn_subr/utf8.c
  (win32_xlate_t): New structure for holding Windows xlate data.
  (discover_windows_codepage_id): New helper for converting page name to Windows
  page identifier.
  (win32_xlate_open): New function to open Windows xlate.
  (win32_convert_to_string_buf): Converts string from one codepage to
another using
  Windows API.
  (get_xlate_handle_node): Use win32_xlate_open() on Windows.
  (convert_to_stringbuf): Use win32_convert_to_stringbuf() on Windows.
]]]

--
Ivan Zhakov
Attachments

« Previous message in topic | 1 of 35 | Next message in topic »

Messages

Show all messages in topic

[PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-06-30 14:45:41 PDT
     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-06-30 19:18:41 PDT
         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-06-30 19:43:51 PDT
             Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-06-30 23:58:44 PDT
                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-01 06:06:02 PDT
                     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) Daniel Rall <dlr at collab dot net> Daniel Rall <dlr at collab dot net> 2007-07-03 09:58:00 PDT
                         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-04 07:48:13 PDT
             Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-05 12:48:46 PDT
                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-05 13:21:09 PDT
                     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) Mark Phippard <markphip at gmail dot com> Mark Phippard <markphip at gmail dot com> 2007-07-05 13:23:59 PDT
                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-07 08:31:40 PDT
                     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-07 15:32:02 PDT
                         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-07 15:47:49 PDT
                             Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-07 18:47:34 PDT
                                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-08 01:06:47 PDT
                         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-07 18:32:05 PDT
     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) steveking Stefan Küng 2007-07-01 00:13:50 PDT
         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-01 08:31:56 PDT
             Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) steveking Stefan Küng 2007-07-01 08:52:52 PDT
                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-02 04:07:15 PDT
                     Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) djh D.J. Heap 2007-07-02 20:49:17 PDT
                         Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-05 02:11:42 PDT
                             Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) Mark Phippard <markphip at gmail dot com> Mark Phippard <markphip at gmail dot com> 2007-07-05 05:58:48 PDT
                                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) chemodax deleted 2007-07-05 06:07:05 PDT
                                 Re: [PATCH] Remove APR ICONV dependency on Windows (was SVN Win32 Developers -- need some help) steveking Stefan Küng 2007-07-05 06:10:53 PDT
Page: of 2 « Previous | Next »
Messages per page: