Seeking Clarity? Amazon AWS Can Provide It
December 17, 2020
AWS increases their AI and machine learnings technology offerings everyday. While AWS is one of the leading providers for AI-powered technology it has yet to overcome AI’s limitations. One of the biggest issues facing AI-powered technology is bias. The best examples of AI bias are facial recognition studies that lack diverse ethnic examples (e.g. black, white, Asian, etc. people).
Amazon developed a solution for bias: Amazon SageMaker Clarify, a tool designed for machine learning developers to gain deeper insight into training data and models to detect bias and explain predictions. Amazon SageMaker Clarify works by:
“SageMaker Clarify is integrated with Amazon SageMaker Data Wrangler, making it easier to identify bias during data preparation. You specify attributes of interest, such as gender or age, and SageMaker Clarify runs a set of algorithms to detect any presence of bias in those attributes. After the algorithm runs, SageMaker Clarify provides a visual report with a description of the sources and measurements of possible bias so that you can identify steps to remediate the bias. For example, in a financial dataset that contains only a few examples of business loans to one age group as compared to others, SageMaker will flag the imbalance so that you can avoid a model that disfavors that age group.”
Eliminating bias detection is a major holdup in AI technology, but SageMaker Clarify is a step in the right direction. Other AI players, including Google, Microsoft, and Apple, are developing their own ways to detect bias.
Whitney Grace, December 17, 2020
Comments
-
- Subscribe to Beyond Search
Feature archive
News archive
-
