shlex - non-posix-mode: error in Multiple occurances of quotes substrings/words #72578

Activity

1. ArnoCan commented on Oct 9, 2016

   

   ArnoCanmannequin

   on Oct 9, 2016

   MannequinAuthor

   More actions

   See also 28391: Multiple occurances of: Closing quotes separate words

   The bpo-28391 is accepted, as it is defined:
   Quotes *within* words are ignored, only a leading quoted string will result in a separate word. (That's recursive: try '"Do""This""Separate).

   So I implement for compatibility mode your proposal.

   But the example does not seem to work as expected, so seems to hint to a bug. Thus openning a seperate issue:

   snip-->
   import shlex

   sopts = """-a "Do""This""Separate" """
   resx = ["-a", '"Do"', 'ThisSeparate', ]
   res=shlex.split(sopts,posix=False)

   print "sopts ="+str(sopts)
   print "resx ="+str(resx)
   print "res ="+str(res)
   assert res == resx

   """
   Results in:

   sopts  =-a "Do""This""Separate" 
   resx   =['-a', '"Do"', 'ThisSeparate']
   res    =['-a', '"Do"', '"This"', '"Separate"']
   Traceback (most recent call last):
     File "shlex_demo.py", line 52, in <module>
       assert res == resx 
   AssertionError

   """

   <--snip

   I also checked the variant with a trailing quoted word for completeness, which is not enclosed. Does not split at all:

   sopts =-a Do"SeparateThis"
   resx =['-a', 'Do', '"SeparateThis"']
   res =['-a', 'Do"SeparateThis"']
2. ArnoCan

   added

   stdlibStandard Library Python modules in the Lib/ directoryStandard Library Python modules in the Lib/ directory

   type-bugAn unexpected behavior, bug, or errorAn unexpected behavior, bug, or error

   on Oct 9, 2016
3. bitdancer commented on Oct 9, 2016

   

   bitdancer

   on Oct 9, 2016

   Member

   More actions

   >>> shlex.split('"Do""This""Separate"', posix=False)
     ['"Do"', '"This"', '"Separate"']
     >>> shlex.split('Do"SeparateThis"', posix=False)
     ['Do"SeparateThis"']

   Both of these are as documented. The first has three separate words, since each word that starts with a leading " is split at the closing quote (thus producing a new word that starts with a "). The last is one word, because the first " is internal to the word that starts at 'Do'.

   In any case, if you find something that disagrees with the docs, we'll just change the docs, because posix=False exists only for backward compatibility so whatever the code actually does is by definition correct at this point.
4. bitdancer

   closed this as completedon Oct 9, 2016
5. bitdancer

   added

   invalid

   on Oct 9, 2016
6. ezio-melotti

   transferred this issue fromon Apr 10, 2022