Showing posts with label data architect. Show all posts
Showing posts with label data architect. Show all posts

Daily Tech Digest - May 19, 2026.


Quote for the day:

“When you connect to the silence within you, that is when you can make sense of the disturbance going on around you.” -- Stephen Richards

🎧 Listen to this digest on YouTube Music

▶ Play Audio Digest

Duration: 21 mins • Perfect for listening on the go.


Why the best security investment a board can make in 2026 isn’t another tool

In this insightful opinion article, cybersecurity expert Jason Martin argues that the most valuable technological investment a corporate board can make is not purchasing another security tool, but rather achieving comprehensive environmental visibility. Traditionally, organizations respond to threats by adding specialized protection platforms, creating a heavily fragmented infrastructure where tools generate massive data but fail to provide unified context. Cybercriminals successfully exploit these operational seams, utilizing legitimate trust relationships or unmonitored human and machine credentials, including automated service accounts, API keys, and emerging AI agents, to bypass siloed defenses entirely without triggering network alerts. True visibility transcends raw logs and complex dashboards; it requires a complete, foundational map of all assets, user permissions, and systemic dependencies, enabling defense teams to reconstruct security incidents in minutes rather than weeks. This dangerous gap between overwhelming technical data and actual operational understanding is further exacerbated by rapid corporate AI adoption, which creates automated connections far faster than governance protocols can track. Therefore, Martin advises boards to shift away from merely asking if they are protected. Instead, corporate leadership must critically ask what their defense teams can actually see, establishing a complete inventory baseline before adding more top-tier detection layers. Drawing this definitive organizational blueprint builds the necessary foundation for absolute, long-term cyber resilience.


CI/CD Was Built for Deterministic Software — Agents Just Broke the Model

The article argues that traditional continuous integration and continuous delivery or CI/CD pipelines, which were built under the assumption of deterministic software repeatability where identical inputs yield identical results, are being disrupted by the rise of agentic artificial intelligence. Because AI agents introduce variance as a core feature by dynamically reasoning, selecting tools, and altering behaviors based on shifting contexts, the conventional binary testing framework of green or red dashboards is no longer sufficient. Instead, DevOps teams must shift to statistical testing methodologies involving comprehensive evaluation sets, scenario libraries, and drift detection. Furthermore, operational management becomes significantly more complex; rolling back systems shifts from reverting a stable binary to unraveling an unpredictable, interconnected chain of decisions and tool interactions. Provenance and observability must also evolve to track prompts, policy configurations, and behavioral intent rather than basic system error codes. Ultimately, traditional deployment models are not entirely obsolete, but they must expand through platform engineering to provide shared governance, simulation environments, and robust guardrails. This extension ensures that autonomous agents can be safely deployed, monitored, and kept within specified organizational boundaries, transforming the ultimate goal of modern DevOps pipelines from merely shipping software to definitively proving and verifying acceptable autonomous behavior.


Why blockchain will be vital for the next generation of biometrics

In this article, Thomas Berndorfer, the CEO of Connecting Software, discusses how blockchain technology will become vital for protecting next generation digital identity and biometric verification systems against sophisticated artificial intelligence driven document manipulation. This pressing cyber threat was underscored by a massive banking scandal in Australia, where sophisticated fraudsters leveraged advanced tools to subtly modify legitimate income records and fraudulently secure billions in loans. Berndorfer emphasizes that while modern biometric passports incorporate strong protections, secondary documentation used for identity verification, such as housing contracts and pay stubs, remains highly susceptible to subtle, undetectable alterations. To effectively mitigate this vulnerability, incorporating a decentralized public blockchain enables issuing organizations to lock digital files with an immutable cryptographic hash, known colloquially as a blockchain seal. Any subsequent modification to the original file yields a completely mismatched hash value, instantly exposing unauthorized tampering to third party verifiers while preserving user privacy by only exposing the hash rather than sensitive underlying personal data. However, the author cautions that blockchain is not a standalone solution; it requires initial issuer sealing at source, cannot identify precisely what information was changed, and fails to differentiate between harmless filename updates and dangerous fraudulent text alterations.


Expanding the Narrative of Business Continuity History

In the article "Expanding the Narrative of Business Continuity History" published in the Disaster Recovery Journal, Samuel McKnight argues that the business continuity and resilience profession possesses a much deeper historical foundation than standard narratives suggest. While traditional accounts trace the discipline’s origins to mainframe computing in the 1960s, followed by programmatic advancements surrounding IT disaster recovery, 9/11, and COVID-19, McKnight uncovers century-old roots through a personal investigation into his great-grandfather’s vintage steel desk. Manufactured by the General Fireproofing Company around 1930, the heirloom led him to a 1924 trade catalogue that passionately advocated for proactively protecting paper business records from devastating urban fires, such as the 1906 San Francisco conflagration. McKnight highlights how this early twentieth-century value proposition, which treated vital documents as the "very breath" of an enterprise's existence, closely mirrors contemporary business continuity management and operational resilience strategies. Ultimately, the author emphasizes that reconstructing this rich history provides modern practitioners with a profound sense of purpose and vocational grounding. It demonstrates that the core mandate of organizational preparedness is not a novel concept but a multi-generational legacy, which continually adapts its protective methods to mitigate systemic vulnerabilities as technology and corporate infrastructure evolve over time.


What is a data architect? Skills, salaries, and how to become a data framework master

The article provides a comprehensive overview contrasting virtual and physical firewalls within modern, dynamic network architectures. Virtual firewalls are software-based security solutions operating on shared compute infrastructure, such as hypervisors, public cloud platforms, and container environments. By decoupling security features from dedicated hardware, they offer programmatic deployment agility, horizontal scaling, and crucial east-west visibility to inspect lateral traffic moving within an environment. However, because they are CPU-bound, virtual instances can experience performance bottlenecks during compute-intensive tasks like high-volume TLS inspection. Conversely, physical firewalls are dedicated hardware appliances built with purpose-designed processors like ASICs. Installed at fixed perimeters, local data centers, or branch offices, they deliver highly predictable, hardware-accelerated throughput for north-south traffic. They remain indispensable for air-gapped systems or strict data sovereignty regulations, though their fixed capacity requires longer procurement and cannot natively follow workloads into public clouds. Ultimately, the article emphasizes that neither solution is universally superior. Instead, most organizations benefit by blending both into a unified hybrid mesh architecture managed through a centralized interface. This holistic approach utilizes physical appliances at high-bandwidth boundaries while deploying virtual firewalls inside cloud infrastructure, ensuring consistent security policies, preventing dangerous policy drift, and reducing management costs across the global network fabric.


Capabilities-Driven Application Modernization: Business Value at Every Step

The article by Melissa Roberts explores how organizations can transition application modernization from strategy to practice using a deliberate, data-driven framework. Rather than rebuilding every application blindly, which often leads to costly failures, companies should use a business capability model paired with a capability heatmap to assess the value, performance, and risk of their operations. Business capabilities are categorized into strategic, core, and supporting layers to help prioritize investments where technology genuinely differentiates the business. Furthermore, the framework requires aligning domains to these capabilities, creating a cross-functional structure that breaks down technical silos. Following Conway's Law, this alignment ensures technical architectures match internal communication patterns, promoting the use of bounded contexts to minimize accidental complexity and avoid monolithic coupling. A domain heatmap visually points executives toward critical, underperforming capabilities that need higher investment, while protecting adequately performing areas from unnecessary spending. Companies often fail when they neglect to connect distinctive capabilities with their corresponding problem domains and underlying technologies. Ultimately, establishing this capability-driven alignment ensures stakeholders realize clear business outcomes, maximizing return on investment while preventing organizations from hemorrhageing capital on redundant or non-essential application modernization initiatives.


Beyond Crisis Management: Why Scenario Planning Must Become a Regular Operating Discipline

The article argues that traditional scenario planning, once treated as a static, annual ritual dominated by hypothetical workshops, is no longer sufficient in an era marked by deep geopolitical fragmentation and supply chain shocks. Modern scenario planning must instead evolve into a continuous, data-driven operating rhythm deeply embedded across core functions like procurement, treasury, logistics, and technology. The strategic focus has shifted from trying to predict exact future outcomes to building collective agility that minimizes organizational paralysis during abrupt changes. To bridge the gap between boardroom discussions and execution, successful multinational enterprises now utilize trigger-based escalation frameworks. By anchoring abstract scenarios to specific, measurable indicators—such as freight thresholds, inventory buffer levels, or shipping delays—organizations can automatically execute predetermined actions before a crisis fully materializes. Furthermore, corporate leadership and investors are reframing resilience as a vital commercial asset, moving scenario mapping into capital allocation and strategic investment decisions. Ultimately, building a resilient enterprise requires cultivating an internal culture that normalizes uncomfortable conversations, encourages leaders to challenge deep-seated assumptions, and treats risk functions not as passive compliance units, but as strategic interpreters of systemic uncertainty.


Bridging Gaps in SOC Maturity Using Detection Engineering and Automation

The DZone article asserts that true Security Operations Center (SOC) maturity requires maintaining a stable, continuous feedback loop where threat detection and response are systematically governed, measured, and optimized. Organizations frequently suffer from uneven operational maturity, where a massive accumulation of raw logs outpaces data normalization capabilities and overwhelms analysts with alert noise. To close these gaps, the article advocates treating detection engineering as a robust control plane. Rather than relying on brittle, static alerts, teams should treat detections as portable, version-controlled software artifacts—such as Sigma rules—backed by explicit telemetry contracts. This systematic structure cleanly separates rule defects from underlying data quality failures. Automation further scales this cycle by introducing programmatic, pre-deployment quality gates and standardizing responses via frameworks like OpenC2, STIX, and TAXII. Instead of using automation to aggressively suppress noisy alerts—which frequently masks the root causes of risks—mature automation enforces behavioral consistency, quality thresholds, and precise telemetry validation before accelerating execution. Ultimately, shifting to an artifact-driven model protects system transparency, prevents operational debt, and alleviates downstream queue pressure. This structural evolution successfully transitions analyst workloads away from repetitive manual triage and allows them to focus on high-value, threat-informed threat hunting and investigation.


Context architecture is replacing RAG as agentic AI pushes enterprise retrieval to its limits

The VentureBeat article outlines a structural transition in enterprise AI infrastructure, where traditional Retrieval-Augmented Generation (RAG) pipelines are being replaced by context architectures. Standard RAG frameworks, which pre-load data into pipelines before model execution, are failing because autonomous AI agents generate vastly larger, continuous data requests than human users. This scale mismatch leaves data scattered and stale. Enterprise buyers are shifting toward custom, hybrid retrieval stacks that flip the paradigm, enabling agents to dynamically pull live, governed, low-latency context at runtime using Model Context Protocol (MCP) tool calls. In response to these market demands, companies like Redis have introduced platforms like Redis Iris. This context and memory platform provides real-time data integration, short- and long-term state tracking, and semantic interfaces while utilizing highly cost-effective storage technologies like Redis Flex to run data on flash. Analyst and market data confirm that retrieval optimization has overtaken evaluation as the top enterprise investment priority. Ultimately, the successful scaling of agentic AI depends on implementing these unified context layers to ensure data is fresh, secure, and cost-efficient, allowing multiple specialized agents to interact simultaneously without causing backend system strain or governance risks.


Can EU AI Act actually regulate models like Mythos?

The Silicon Republic article explores the regulatory challenges surrounding frontier AI models, focusing on Anthropic's powerful "Mythos" system. Discovered as an unintentional byproduct of coding and autonomy improvements, Mythos has triggered global security discussions due to its defensive capabilities and potential systemic cyber risks. This disruption has heavily strained start-ups and SMEs, which face immense pressure to constantly patch digital products and services. Joseph Stephens, director of resilience at Ireland's National Cyber Security Centre (NCSC), emphasizes that individual states have limited power to block independent, US-based rollouts. Consequently, the EU and member nations are seeking a highly coordinated regulatory framework. While the EU AI Act includes provisions designed to mitigate systemic dangers and offensive cyber capabilities, its practical application remains restricted by geographical bounds. Legal expert Dr. TJ McIntyre notes that the extraterritorial regulation of models like Mythos is only possible if the systems or their outputs are directly sold within the European Union. If Anthropic uses geo-restricting measures to block availability inside the bloc, enforcement under the Act becomes deeply uncertain. Ultimately, while the AI Act represents a groundbreaking attempt to police advanced software marketplaces safely, officials acknowledge that governments cannot entirely regulate their way out of accelerating technological advancements.

Daily Tech Digest - November 22, 2024

AI agents are coming to work — here’s what businesses need to know

Defining exactly what an agent is can be tricky, however: LLM-based agents are an emerging technology, and there’s a level of variance in the sophistication of tools labelled as “agents,” as well as how related terms are applied by vendors and media. And as with the first wave of generative AI (genAI) tools, there are question marks around how businesses will use the technology. ... With so many tools in development or coming to the market, there’s a certain amount of confusion among businesses that are struggling to keep pace. “The vendors are announcing all of these different agents, and you can imagine what it’s like for the buyers: instead of ‘The Russians are coming, the Russians are coming,’ it’s ‘the agents are coming, the agents are coming,’” said Loomis. “They’re being bombarded by all of these new offerings, all of this new terminology, and all of these promises of productivity.” Software vendors also offer varying interpretations of the term “agent” at this stage, and tools coming to market exhibit a broad spectrum of complexity and autonomy. ... Many of the agent builder tools coming to business and work apps require little or no expertise. This accessibility means a wide range of workers could manage and coordinate their own agents.


The limits of AI-based deepfake detection

In terms of inference-based detection, ground truth is never known and assumed as such, so detection is based on a one to ninety-nine percentage that the content in question is or is not likely manipulated. Inference-based platform needs no buy-in from platforms, but instead needs robust models trained on a wide variety of deepfaking techniques and technologies in various use cases and circumstances. To stay ahead of emerging threat vectors and groundbreaking new models, those making an inference-based solution can look to emerging gen AI research to implement such methods into detection models as or before such research becomes productized. ... Greater public awareness and education will always be of immense importance, especially in places where content is consumed that could potentially be deepfaked or artificially manipulated. Yet deepfakes are getting so convincing, so realistic that even storied researchers now have a hard time differentiating real from fake simply by looking at or listening to a media file. This is how advanced deepfakes have become, and they will only continue to grow in believability and realism. This is why it is crucial to implement deepfake detection solutions in the aforementioned content platforms or anywhere deepfakes can and do exist. 


Quantum error correction research yields unexpected quantum gravity insights

So far, scientists have not found a general way of differentiating trivial and non-trivial AQEC codes. However, this blurry boundary motivated Liu, Daniel Gottesman of the University of Maryland, US; Jinmin Yi of Canada’s Perimeter Institute for Theoretical Physics; and Weicheng Ye at the University of British Columbia, Canada, to develop a framework for doing so. To this end, the team established a crucial parameter called subsystem variance. This parameter describes the fluctuation of subsystems of states within the code space, and, as the team discovered, links the effectiveness of AQEC codes to a property known as quantum circuit complexity. ... The researchers also discovered that their new AQEC theory carries implications beyond quantum computing. Notably, they found that the dividing line between trivial and non-trivial AQEC codes also arises as a universal “threshold” in other physical scenarios – suggesting that this boundary is not arbitrary but rooted in elementary laws of nature. One such scenario is the study of topological order in condensed matter physics. Topologically ordered systems are described by entanglement conditions and their associated code properties. 


Towards greener data centers: A map for tech leaders

The transformation towards sustainability can be complex, involving key decisions about data center infrastructure. Staying on-premises offers control over infrastructure and data but poses questions about energy sourcing. Shifting to hybrid or cloud models can leverage the innovations and efficiencies of hyperscalers, particularly regarding power management and green energy procurement. One of the most significant architectural advancements in this context is hyperconverged infrastructure (HCI). As we know, traditionally data centers operate using a three-tier architecture comprising separate servers, storage, and network equipment. This model, though reliable, has clear limitations in terms of energy consumption and cooling efficiency. By merging the server and storage layers, HCI reduces both the power demands and the associated cooling requirements. ... The drive to create more efficient and environmentally conscious data centers is not just about cost control; it’s also about meeting the expectations of regulators, customers, and stakeholders. As AI and other compute-intensive technologies continue to proliferate, organizations must reassess their infrastructure strategies, not just to meet sustainability goals but to remain competitive.


What is a data architect? Skills, salaries, and how to become a data framework master

The data architect and data engineer roles are closely related. In some ways, the data architect is an advanced data engineer. Data architects and data engineers work together to visualize and build the enterprise data management framework. The data architect is responsible to visualize the blueprint of the complete framework that data engineers then build. ... Data architect is an evolving role and there’s no industry-standard certification or training program for data architects. Typically, data architects learn on the job as data engineers, data scientists, or solutions architects, and work their way to data architect with years of experience in data design, data management, and data storage work. ... Data architects must have the ability to design comprehensive data models that reflect complex business scenarios. They must be proficient in conceptual, logical, and physical model creation. This is the core skill of the data architect and the most requested skill in data architect job descriptions. This often includes SQL development and database administration. ... With regulations continuing to evolve, data architects must ensure their organization’s data management practices meet stringent legal and ethical standards. They need skills to create frameworks that maintain data quality, security, and privacy.


AI – Implementing the Right Technology for the Right Use Case

Right now, we very much see AI in this “peak of inflated expectations” phase and predict that it will dip into the “trough of disillusionment”, where organizations realize that it is not the silver bullet they thought it would be. In fact, there are already signs of cynicism as decision-makers are bombarded with marketing messages from vendors and struggle to discern what is a genuine use case and what is not relevant for their organization. This is a theme that also emerged as cybersecurity automation matured – the need to identify the right use case for the technology, rather than try to apply it across the board.. ... That said, AI is and will continue to be a useful tool. In today’s economic climate, as businesses adapt to a new normal of continuous change, AI—alongside automation—can be a scale function for cybersecurity teams, enabling them to pivot and scale to defend against evermore diverse attacks. In fact, our recent survey of 750 cybersecurity professionals found that 58% of organizations are already using AI in cybersecurity to some extent. However, we do anticipate that AI in cybersecurity will pass through the same adoption cycle and challenges experienced by “the cloud” and automation, including trust and technical deployment issues, before it becomes truly productive. 


A GRC framework for securing generative AI

Understanding the three broad categories of AI applications is just the beginning. To effectively manage risk and governance, further classification is essential. By evaluating key characteristics such as the provider, hosting location, data flow, model type, and specificity, enterprises can build a more nuanced approach to securing AI interactions. A crucial factor in this deeper classification is the provider of the AI model. ... As AI technology advances, it brings both transformative opportunities and unprecedented risks. For enterprises, the challenge is no longer whether to adopt AI, but how to govern AI responsibly, balancing innovation against security, privacy, and regulatory compliance. By systematically categorizing generative AI applications—evaluating the provider, hosting environment, data flow, and industry specificity—organizations can build a tailored governance framework that strengthens their defenses against AI-related vulnerabilities. This structured approach enables enterprises to anticipate risks, enforce robust access controls, protect sensitive data, and maintain regulatory compliance across global jurisdictions. The future of enterprise AI is about more than just deploying the latest models; it’s about embedding AI governance deeply into the fabric of the organization.


Business Continuity Depends on the Intersection of Security and Resilience

The focus of security, or the goal of security, or the intended purpose of security in its most natural and traditional form, right before we start to apply it to other things, is to prevent bad things from happening, or protect the organization or protect assets. It doesn't necessarily have to be technology that does it. This is where your policies and procedures come into place. Letting users know what acceptable use policies are or what things are accepted when leveraging corporate resources. From a technology perspective, it's your firewalls, antivirus, intrusion detection systems and things of that nature. So, this is where we focus on good cyber hygiene. We're controlling the controllables and making sure that we're taking care of the things that are within our control. What about resilience? This one is near and dear to my heart. That's because I've been in tech and security for almost 25 years, and I've kind of gone through this evolution of what I think is important. We're trained as practitioners in this industry to believe that the goal is to reduce risk. We must reduce or mitigate cyber risk, or we can make other risk decisions. We can avoid it, we can accept it, or we can transfer it. But practically speaking, when we show up to work every day and we're doing something active, we're reducing risk.


How to stop data mesh turning into a data mess

Realistically, expecting employees to remember to follow data quality and compliance guidelines is neither fair nor enforceable. Adherence must be implemented without frustrating users, and become an integral part of the project delivery process. Unlikely as this sounds, a computational governance platform can impose the necessary standards as ‘guardrails’ while also accelerating the time to market of products. Sitting above an organisation’s existing range of data enablement and management tools, a computational governance platform ensures every project follows pre-determined policies, for quality, compliance, security, and architecture. Highly customisable standards can be set at global or local levels, whatever is required. ... While this might seem restrictive, there are many benefits from having a standardised way of working. To streamline processes, intelligent automated templates help data practitioners quickly initiate new projects and search for relevant data. The platform can oversee the deployment of data products by checking their compliance and taking care of the resource provisioning, freeing the teams from the burden of coping with infrastructure technicalities (on cloud or on-prem) and certifying data product compliance at the same time, before data products enter production. 


The SEC Fines Four SolarWinds Breach Victims

Companies should ensure the cyber and data security information they share within their organizations is consistent with what they share with government agencies, shareholders and the public, according to Buchanan Ingersoll & Rooney’s Sanger. This applies to their security posture prior to a breach, as well as their responses afterward. “Consistent messaging is difficult to manage given that dozens, hundreds or thousands could be responsible for an organization’s cybersecurity. Investigators will always be able to find a dissenting or more pessimistic outlook among the voices involved,” says Sanger. “If there is a credible argument that circumstances are or were worse than what the organization shares publicly, leadership should openly acknowledge it and take steps to justify the official perspective.” Corporate cybersecurity breach reporting is still relatively uncharted territory, however. “Even business leaders who intend to act with complete transparency can make inadvertent mistakes or communicate poorly, particularly because the language used to discuss cybersecurity is still developing and differs between communities,” says Sanger. “It’s noteworthy that the SEC framed each penalized company as having, ‘negligently minimized its cybersecurity incident in its public disclosures.’ 



Quote for the day:

"Perfection is not attainable, but if we chase perfection we can catch excellence." -- Vince Lombardi