Claim adjudication, the process of determining the financial liability of a claim by the insurance company, is quite complex and time-consuming. Adjudication can be quick if the received claim is clear to the dot, in the sense that all the information is accurate and the claim is within the limits of the policy. But, as with all things in life, this is never the case.
(more…)
PySparkCLI—An Efficient Way to Manage Your PySpark Projects
In the world of big data analytics, PySpark, the Python API for Apache Spark, has a lot of traction because of its rapid development possibilities. Apart from Python, it provides high-level APIs in Java, Scala and R. Despite the simplicity of the Python interface, creating a new PySpark project involves the execution of long commands. Take for example the command to create a new project:
$SPARK_HOME/bin/spark-submit \ --master local[*] \ --packages 'com.somesparkjar.dependency:1.0.0' \ --py-files packages.zip \ --files configs/etl_config.json \ jobs/etl_job.py
It is NOT the most convenient or intuitive method to create a simple file structure.
So is there an easy way to get started with PySpark?
(more…)
Ease the “Full-Stack Pressure” with Laravel Livewire
In the contemporary web development world, being a full-stack developer is the new norm. You may be a backend or front end developer, but you are expected to know technologies outside your field of specialization. Talk about full-stack pressure! I was a PHP developer when I felt this pressure for the first time. There is no question that JavaScript is a great language. But, for me, who was more into PHP or server-side, it was a bit overwhelming. That scene has changed with the arrival of Laravel Livewire.
(more…)
Comparative Analysis of ML Models for Fraud Detection
A large variety of fraud patterns combined with insufficient data on fraud makes insurance fraud detection a very challenging problem. Many algorithms are available today to classify fraudulent and genuine claims. To understand the various classification algorithms applied in fraud detection, I did a comparison using vehicle insurance claims data.
(more…)
Generating Malayalam Word Embeddings: A Case Study
Research shows that children primarily learn languages by observing patterns in the words they hear. Computer scientists are taking a similar approach to train computers to process human language.
NLP Libraries for Malayalam Sentence Tokenization: An Exploratory Study
Imagine that you are working on machine translation or a similar Natural Language Processing (NLP) problem. Can you process the corpus as a whole? No. You will have to break it into sentences first and then into words. This process of splitting input corpus into smaller subunits is known as tokenization. The resulting units are tokens. For instance, when paragraphs are split into sentences, each sentence is a token. This is a fairly straightforward process in English but not so in Malayalam (and some other Indic languages).
(more…)
Jetpack Compose—A Modern Declarative UI Toolkit for Android
In the dynamic realm of Android app development, it is not uncommon for new libraries, SDKs, and architectures to rise and fall and new features to get added or removed each year. Among the few things to survive the flux, the XML-based UI toolkit is relied on by developers to build user interfaces of all kinds. It is a bit of a tedious process: UI layouts are defined in an XML file, accessed and processed inside Kotlin files.
That normal is now slowly changing. Declarative and reactive UI toolkits and frameworks are shaking things up.
(more…)
Conversational AI Chatbot: Architecture Overview
Artificial Intelligence (AI) powers several business functions across industries today, its efficacy having been proven by many intelligent applications. Of the lot, chatbots are perhaps the most well-known. From healthcare to hospitality, retail to real estate, insurance to aviation, chatbots have become a ubiquitous and useful feature. But how are these chatbots created? Let’s take a look at the architecture of a conversational AI chatbot.
(more…)
A Friendly Intro to SOAP Web Services in Adobe Campaign
The option to communicate with external systems is a cool feature to have in any platform. In Adobe Campaign, daily updates from external systems are made via a CSV or TXT file. But what if we want to push real-time data to Adobe Campaign, and more specifically to the recipient table? Then we have to make use of SOAP web services.
(more…)
RPA—It’s Time to Take the Plunge
We all know the saying “Tough times never last, but tough people do.” We are going through one of the toughest times of our generation and the situation requires us to toughen up too. Businesses took a hit when the pandemic struck and had to improvise drastically to cope. Some had to scale down their operations while many others resumed with an almost entirely remote workforce. Only a small fraction of businesses are in a position to say they are highly prepared to deal with the impact according to Gartner’s recent Business Continuity Survey.
(more…)