UTF-8 editing in 2.8.7dev.8

HI PEOPLE,

THE NEW VERSION INDEED HAS M?U?C?H? BETTER EDITING
CAPABILITIES FOR UTF-8,
WITH REGARDS TO CURSOR POSITIONING AND BACKSPACE HANDLING.
THE EXCEPTION
IS CJK CHARACTERS (DOUBLE-WIDE, E.G. ?•), WHICH MAKE THE
CURSOR MIS-
POSITION, AGAIN. STILL, IT'S WORTH THE UPGRADE!

TOM, YOU SHOULD REALLY LOOK AT SOME NON-ENGLISH WEBPAGES
USING LYNX TO
TEST ALL THIS, FOR EXAMPLE FORM FIELDS ARE NOW LIKE THIS:

   [23]« [24][(2)__2. TAG 2: FAHRRAD FAHREN WILL GELERNT
SEIN_]
                                                            
   [25]»
WHEN USING ONLY ASCII CHARACTERS, BUT
   [23]« [24][(7)__7. SPECIAL: FILCHS
KäMMERCHEN______________
                                                            
   [25]»
WHEN HAVING NON-ASCII UNICODE CHARACTERS INSIDE.



MY OPTIONS SCREEN STILL LOOKS LIKE THIS:

  GENERAL PREFERENCES
  USER MODE                        : [5][(3)__ADVANCED____]
  EDITOR                           :
[6]JUPP_____________________________________________________
________________
_
  TYPE OF SEARCH                   : [7][(1)__CASE
INSENSITIVE]

... SO NOTHING HAS CHANGED HERE,
LINKS-AND-FORM-FIELDS-ARE-NUMBERED STILL
LEADS TO MIS-DISPLAYING THINGS.

DISABLING IT DOESN'T HELP HERE:

   « [7. SPECIAL: FILCHS KäMMERCHEN______________
                                                   »

HM. IT DOESN'T HELP THE OPTIONS SCREEN EITHER:

  GENERAL PREFERENCES
  USER MODE                        : [ADVANCED____]
  EDITOR                           :
JUPP________________________________________________________
________________
_
  TYPE OF SEARCH                   : [CASE INSENSITIVE]


THIS IS MIRBSD #10-RELEASE, NCURSESW 5.5.

BYE,
//MIRABILOS
-- 
I BELIEVE NO ONE CAN INVENT AN ALGORITHM. ONE JUST HAPPENS
TO HIT UPON IT
WHEN GOD ENLIGHTENS HIM. OR ONLY GOD INVENTS ALGORITHMS, WE
MERELY COPY THEM.
IF YOU DON'T BELIEVE IN GOD, JUST CONSIDER GOD AS NATURE IF
YOU WON'T DENY
EXISTENCE.		-- COYWOLF QI HUNT


_______________________________________________
LYNX-DEV MAILING LIST
LYNX-DEVNONGNU.ORG
HTTP://LISTS.NONGNU.ORG/MAILMAN/LISTINFO/LYNX-DEV

On Wed, 12 Mar 2008, Thorsten Glaser wrote:

> Hi people,
>
> the new version indeed has m̲u̲c̲h̲ better editing
capabilities for UTF-8,
> with regards to cursor positioning and backspace
handling. The exception
> is CJK characters (double-wide, e.g. 何), which make
the cursor mis-
> position, again. Still, it's worth the upgrade!

I did test this with Japanese characters which had
double-width, and
recall that moving the cursor within the edited text was
working properly.
That should have been enough to verify this aspect - either
I'm missing
something, or your curses+iconv+terminal configuration isn't
doing it
properly.  (For reference, I'd look at the dialog program,
which is where
I got the examples).

Beyond that - the key-binding part of the code probably
requires some
further work.

>
> Tom, you should really look at some non-English
webpages using Lynx to
> test all this, for example form fields are now like
this:
>
>   [23]« [24][(2)__2. Tag 2: Fahrrad fahren will
gelernt sein_]
>                                                        
       [25]»
> when using only ASCII characters, but
>   [23]« [24][(7)__7. Special: Filchs
Kämmerchen______________
>                                                        
       [25]»
> when having non-ASCII unicode characters inside.
>
>
>
> My options screen still looks like this:
>
>  General Preferences
>  User mode                        :
[5][(3)__Advanced____]
>  Editor                           :
[6]jupp_____________________________________________________
________________
> _
>  Type of Search                   : [7][(1)__Case
insensitive]
>
> .... so nothing has changed here,
links-and-form-fields-are-numbered still
> leads to mis-displaying things.
>
> Disabling it doesn't help here:
>
>   « [7. Special: Filchs Kämmerchen______________
>                                                   »
>
> Hm. It doesn't help the options screen either:
>
>  General Preferences
>  User mode                        : [Advanced____]
>  Editor                           :
jupp________________________________________________________
________________
> _
>  Type of Search                   : [Case insensitive]
>
>
> This is MirBSD #10-RELEASE, ncursesw 5.5.
>
> bye,
> //mirabilos
> -- 
> I believe no one can invent an algorithm. One just
happens to hit upon it
> when God enlightens him. Or only God invents
algorithms, we merely copy them.
> If you don't believe in God, just consider God as
Nature if you won't deny
> existence.		-- Coywolf Qi Hunt
>
>
> _______________________________________________
> Lynx-dev mailing list
> Lynx-devnongnu.org
> htt
p://lists.nongnu.org/mailman/listinfo/lynx-dev
>
>

-- 
Thomas E. Dickey
http://invisible-island.n
et
ftp://invisible-island.net
_______________________________________________
Lynx-dev mailing list
Lynx-devnongnu.org
htt
p://lists.nongnu.org/mailman/listinfo/lynx-dev

THOMAS DICKEY DIXIT:

> BEYOND THAT - THE KEY-BINDING PART OF THE CODE PROBABLY
REQUIRES SOME
> FURTHER WORK.

I JUST COPY€™N€™PASTE FROM:
HTTP://CVS.MIRBSD.DE/CONTRIB/SAMPLES/KANA?REV=HEAD
HTTP://CVS.MIRBSD.DE/CONTRIB/SAMPLES/UTF-8?REV=HEAD
€¦ WHAT IS NOT IN MY .XMODMAP:
HTTP://CVS.MIRBSD.DE/CONTRIB/SAMPLES/DOT.XMODMAP?REV=HEAD

BYE,
//MIRABILOS
-- 
I BELIEVE NO ONE CAN INVENT AN ALGORITHM. ONE JUST HAPPENS
TO HIT UPON IT
WHEN GOD ENLIGHTENS HIM. OR ONLY GOD INVENTS ALGORITHMS, WE
MERELY COPY THEM.
IF YOU DON'T BELIEVE IN GOD, JUST CONSIDER GOD AS NATURE IF
YOU WON'T DENY
EXISTENCE.		-- COYWOLF QI HUNT


_______________________________________________
LYNX-DEV MAILING LIST
LYNX-DEVNONGNU.ORG
HTTP://LISTS.NONGNU.ORG/MAILMAN/LISTINFO/LYNX-DEV