Automate This

1. Algorithms are revolutionizing financial markets and beyond

Algorithms allow us to squeeze more and more into our days.

Algorithmic takeover. Algorithms have transformed financial markets, with over 60% of all trades now executed by computers. This revolution began on Wall Street but has spread to various aspects of our lives. Algorithms now influence everything from music composition to medical diagnostics, reshaping industries and decision-making processes.

Widespread impact. The power of algorithms extends beyond finance:

• Customer service: Bots analyze conversations to improve satisfaction
• Healthcare: Algorithms assist in diagnoses and treatment plans
• Transportation: Self-driving cars use complex algorithms for navigation
• Entertainment: Streaming services use algorithms for personalized recommendations

As algorithms become more sophisticated, they are increasingly able to perform tasks once thought to require human intuition and creativity.

2. The evolution of algorithmic trading on Wall Street

To trade is to dig.

Peterffy's innovation. Thomas Peterffy pioneered algorithmic trading on Wall Street in the 1980s. He developed a system that could automatically analyze market data and execute trades faster than human traders. This innovation gave him a significant advantage in the markets and paved the way for future developments in algorithmic trading.

Spread Networks. The quest for speed in algorithmic trading led to extreme measures:

• Construction of a secret fiber optic cable between New York and Chicago
• Reduced latency by milliseconds, providing a crucial edge in high-frequency trading
• Demonstrated the lengths traders would go to gain an algorithmic advantage

The evolution of algorithmic trading has fundamentally changed the nature of financial markets, making them faster, more complex, and increasingly dominated by computer-driven strategies.

3. Algorithms are transforming music composition and analysis

Cannot the fervor / Over the river's ending / Be postponed to now?

AI composers. David Cope's work on algorithmic music composition has shown that computers can create music indistinguishable from human-composed pieces. His algorithms, such as EMI and Emily Howell, have produced works in the style of classical composers and original compositions.

Music analysis. Algorithms are also being used to analyze and understand music:

• Identifying patterns and structures in compositions
• Predicting hit songs based on musical characteristics
• Unraveling mysteries in famous works, like the Beatles' chord progressions

These developments challenge our understanding of creativity and raise questions about the future of human composers in an increasingly algorithmic world.

4. Medical diagnostics and organ matching are being revolutionized by algorithms

Machines run on binary mathematics. Human's don't.

Improving diagnostics. Algorithms are enhancing medical diagnostics by analyzing vast amounts of data and identifying patterns that humans might miss. This has led to:

• More accurate cancer detection in medical imaging
• Faster and more precise interpretation of test results
• Personalized treatment plans based on individual patient data

Organ matching. Tuomas Sandholm's work on kidney exchange algorithms has dramatically improved the efficiency of organ donation systems. By using complex algorithms to match donors and recipients, more lives are being saved through increased transplant opportunities.

These advancements demonstrate the potential for algorithms to improve healthcare outcomes and save lives by augmenting human decision-making in complex medical situations.

5. Algorithms are changing how we understand and categorize human personalities

We are categorizing the human language.

NASA's personality assessment. Terry McGuire developed a system at NASA to categorize astronauts' personalities and predict their behavior under stress. This work laid the foundation for algorithmic personality assessment in various fields.

Modern applications. Today, algorithms analyze speech patterns and written communication to:

• Match customers with compatible customer service representatives
• Improve team dynamics in workplaces
• Enhance online dating matches
• Predict consumer behavior for marketing purposes

These developments raise both opportunities and concerns about privacy and the ethical use of personal data in algorithmic decision-making.

6. The shift of top talent from Wall Street to Silicon Valley

It used to be if you went to Harvard or Yale, you wanted to be a finance titan. But now everybody wants to be a Zuckerberg.

Talent migration. The 2008 financial crisis and the rise of tech giants like Facebook and Google led to a shift in where top engineering and mathematical talent chose to work. Many bright minds who once would have gone to Wall Street are now drawn to Silicon Valley.

Impact on innovation. This shift has implications for innovation and economic growth:

• More talent focused on solving real-world problems through technology
• Increased entrepreneurship in the tech sector
• Potential for more diverse and impactful applications of algorithmic thinking

The movement of talent from finance to tech reflects changing priorities and opportunities in the algorithmic age.

7. The future belongs to those who can create and manipulate algorithms

Get friendly with bots.

Skills for the future. As algorithms become more prevalent in various industries, the ability to create, understand, and work with them will be increasingly valuable. This trend highlights the importance of:

• STEM education, particularly in computer science and mathematics
• Developing critical thinking and problem-solving skills
• Fostering creativity in conjunction with technical knowledge

Ethical considerations. The growing power of algorithms raises important ethical questions:

• Privacy concerns in data collection and analysis
• Potential for algorithmic bias and discrimination
• The need for transparency and accountability in algorithmic decision-making

As we move further into an algorithm-driven world, it will be crucial to balance the benefits of these technologies with careful consideration of their societal impacts.

Last updated: January 24, 2025