跳至主要内容

博文

目前显示的是标签为“timestamp”的博文

Functional scala Try Success Failure and for composition

 Lesson learn Scala programming I got some Scala to write in a recent spark related project. Specially, the Scala UDF (aka. user defined function) to be used in spark application. I got a feel that Try, Success, Failure is not very useful until being applied to the For Comprehensions for automatically unpacking. Refer to the following code example (inspired by StackOverFlow Post ) import java.sql.Timestamp import org.apache.spark.sql.functions.udf import scala.util.{Try, Success, Failure} // combine time_date and time_time for a timestamp in UTC. val time_to_ts: ((String, String) => Option[Timestamp]) = (time_date, time_time) => { val time_time_a = time_time.split(':') val ts = for ( y <- Try(time_date.take(4).toInt); // toInt exception m <- Try(time_date.take(6).takeRight(2).toInt); // toInt exception d <- Try(time_date.take(8).takeRight(2).toInt); // toInt exception tsymd <- Try(Timestamp.valueOf(s"$y-$m-$d 0:0:...