Python 2 handles UTF-8 fine. (It's just not the default representation.)

@ariddell: Can you provide a link with an example/description? Then I could update the list.

RStudio should work https://support.rstudio.com/hc/en-us/articles/200532197-Character-Encoding

@tpapp https://docs.python.org/2/howto/unicode.html Python 3 uses Unicode by default. In Python 2 you need to be explicit about it. In both cases you can have unicode strings in source code.

@ariddell: in the page you link I could not find an example with unicode identifiers (only strings, literals, filenames, etc).

Here's a link to the section: https://docs.python.org/2/howto/unicode.html#unicode-literals-in-python-source-code

Those are unicode literals, not unicode identifiers.

Can you have

éø = 10

where you assign to a unicode literal? Or dictionaries
with unicode keys?

• Bob

On May 11, 2016, at 1:24 PM, Allen Riddell [email protected] wrote:

Here's a link to the exact section: https://docs.python.org/2/howto/unicode.html#unicode-literals-in-python-source-code

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub

You're right. In Python 2.7 you can't have unicode variables. In Python 3 you can. But why does that matter? We only need unicode in the Stan program code. (Parameter lookups aren't affected since keys are and always were strings.)

It looks like you use a dictionary structure for variable
names.

schools_dat = {
'J': 8,
'y': [28, 8, -3, 7, -1, 1, 18, 12],
'sigma': [15, 10, 16, 11, 9, 11, 10, 18]
}

Can the keys be unicode?

RStan can read data values out of the environment if they're
named after variables in the Stan program. And it can attach
the resulting draws as variables in the environment.

• Bob

On May 11, 2016, at 4:07 PM, Allen Riddell [email protected] wrote:

You're right. In Python 2.7 you can't have unicode variables. In Python 3 you can. But why does that matter? We only need unicode in the Stan program code. (Parameter lookups aren't affected since keys are and always were strings.)

—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub

Python 2 has no problems with unicode dictionary keys. In fact, it can
have unicode variables in the environment but you have to reference them
via strings indirectly. For example, this works in Python 2:

>>> locals()[u'é'] = 9
>>> locals()[u'é']

(locals is something like baseenv or .GlobalEnv in R)

Bref, there is nothing Python 2 can't do that's relevant to supporting
unicode in Stan code. The table above is inaccurate.

On 05/11, Bob Carpenter wrote:

It looks like you use a dictionary structure for variable
names.

schools_dat = {
'J': 8,
'y': [28, 8, -3, 7, -1, 1, 18, 12],
'sigma': [15, 10, 16, 11, 9, 11, 10, 18]
}

Can the keys be unicode?

RStan can read data values out of the environment if they're
named after variables in the Stan program. And it can attach
the resulting draws as variables in the environment.

• Bob

On May 11, 2016, at 4:07 PM, Allen Riddell [email protected] wrote:

You're right. In Python 2.7 you can't have unicode variables. In Python 3 you can. But why does that matter? We only need unicode in the Stan program code. (Parameter lookups aren't affected since keys are and always were strings.)

—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub

---

You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub:
#1406

On May 12, 2016, at 8:20 AM, Allen Riddell [email protected] wrote:

Python 2 has no problems with unicode dictionary keys. In fact, it can
have unicode variables in the environment but you have to reference them
via strings indirectly. For example, this works in Python 2:

>>> locals()[u'é'] = 9
>>> locals()[u'é']

(locals is something like baseenv or .GlobalEnv in R)

Bref, there is nothing Python 2 can't do that's relevant to supporting
unicode in Stan code. The table above is inaccurate.

You should have edit permission on the issues.

• Bob

I was just recording my thought on the matter. I appreciate @tpapp putting work into drafting the issue text and would prefer to leave any edits to him.

@ariddell: The table was accurate, but since not all Stan interfaces work the way that R/Julia does, I extended it with the information that is probably most relevant: whether the interfaces, in the way they currently operate, would support UTF8 variables for (1) passing data to Stan and (2) extracting MCMC results. Thanks for pointing this out, this is much more important than the details of UTF8 support in those languages per se.

Not being a STATA user, I am reluctant to make a definitive statement about it. If someone could help with that it would be great.

One use of unicode in Stan Program code which should definitely be supported is in comments. Leaving code comments in one's native language is fairly routine in Python/Java/etc. We should at least support that in Stan.

Unicode in comments is OK now.

• Bob

On May 14, 2016, at 7:28 PM, Allen Riddell [email protected] wrote:

One use of unicode in Stan Program code which should definitely be supported is in comments. Leaving code comments in one's native language is fairly routine in Python/Java/etc. We should at least support that in Stan.

—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub

Indeed UTF8 comments work fine, and I have been using them for a while. Made a clarification in the issue.

UTF8 comments aren't supported in PyStan right now (non-ASCII characters will generate an error). I'll fix this. stan-dev/pystan#223