Provide support for C# on Databricks
There are (at least) two use cases of it:
- Migrate large number of (hundreds) data pipelines running on ADLA to Databrick. Those data pipelines usually have heavy business logic built in C# library. It will be a huge cost to re-write the code in Java
- Most ML applications have online prod environment and offline experiment environment. If the application has parts of its logic built in C# library (e.g. featuring), it will be a big headache if prod environment only allows .net library while the offline experiment does not support it, i.e. having to maintain two code bases.
Ronen Ariely (pituach) commented
Check this project;
Alex KeySmith commented
I spotted this: https://databricks.com/session/mobius-c-language-binding-for-spark are you considering U-SQL on DataBricks as well?