Supporting unrelated embedded content in virtualBuffers (Adobe Flash, Microsoft Silverlight, Java applets)

• Should Flash / Silverlight be rendered as flat content at all? Depends whether it looks like an application or document.
• If a flat representation must be rendered, should each c++ backend have the ability to switch to a Flash or Silverlight backend for that subtree? this would be rather tricky and would require quite a large rewrite of the virtualBuffer library.
• Should NVDA instead have the ability to embed virtualBuffers with in virtualBuffers? so on the NVDA side it could embed a flash / silverlight virtualBuffer at the point of that content. This would mean that backends did not have to know about other backends.

Support for ARIA live regions

• Code to detect live region changes can be in nvdaHelperRemote.
• Should live region detection code be integrated with virtualBuffers, and therefore only available there?
  • If in virtualBuffers, then the text that should be reported for the live region can be retreaved from the virtualBuffer. Otherwize live region code may have to duplicate rendering code to produce appropriate text.
  • I'm sure many web apps will consider using live regions, including web apps that should be treeted as applications, not documents. Therefore live regions only in virtualBuffers would be a bad idea.
• How should live region detection code communicate live region changes bac to NVDA? winEvents? an rpc server in NVDA? a COM server in NVDA?
  • WinEvents? may be bad as text can not be transfered with the event.
  • An RPC server is probably the easiest, though due to a lack of support for RPC in Python c/c++ rpc code would need to call python callback functions, which splits the server over separate codebases.
  • a COM server means most of it can be implemented in Python, though a lot of experimenting will need to be done as we have not delt with this before.

Support for Text Services Framework (for I18N input)

• Perhaps one RPC interface in nvdaHelperRemote, and one COM/RPC server in nvdaHelperLocal?
• What are the most important features to have?
  • List of candidate symbols
  • Access to current input buffer via a TextInfo?