Skip navigation
Twitter   Follow us  •   Share   Share    Become a member

Smart Architect

5 Posts tagged with the soa tag
0

Have you been paying attention to how the mainframe’s role will evolve as your enterprise architecture strategy matures? You should be, considering that these systems continue to make up a significant part of business infrastructure. In several recent independent studies on behalf of CA Technologies, a significant majority of senior-level mainframe decision-makers (between 80 and 88 percent) responded that they believe mainframe applications remain a key business asset. 

 

My advice is that enterprise architects should be thinking of how to help their companies leverage these data center assets as viable candidates for private cloud-based transaction processing. Modern mainframes fit the bill because they are all about redundant internal components, high-speed and high-bandwidth I/O, flexibility to run both modern and legacy software, high security and extreme reliability. And, as Guillermo Merino notes in Saluting the Mainframe, only Google’s massive server farm comes close to rivaling the mainframe’s transaction-processing scale. 

 

How to allow mainframe workload processing to continue into the 21st century world of private clouds while reducing cost and complexity? The workflow-centric approach integrates well into modern SOA (service-oriented architecture)-based solutions.

 

The “Big” Event

 

An efficient way to integrate classic mainframe processing into a modern private cloud-based SOA is through event processing, where events can be used as inputs and outputs to workloads executed on the mainframe. For example, your Java EE software can trigger the batch processing of perhaps hundreds of thousands of transactions on the mainframe, where the results are delivered in real time, and perhaps stored in a database management system (DBMS) or NoSQL database. Thanks to these triggers, the entire system can remain technology agnostic, with no need to be concerned that it’s a mainframe providing the high transaction-per-second (TPS) processing rate behind the scenes. This is particularly important because it allows enterprise architects to strategize around the mainframe even as COBOL and JCL development skills are on the decline. Many CIOs are concerned about the looming mainframe skills shortage, as older workers with these talents retire and the younger generation isn’t equipping itself to replace them (see this article).

 

 

ericpixnew.jpg

 

 

In Figure 1, you can see how triggers throughout the system become events that can be processed anywhere in the data center, including on its resident mainframes. On the left are event sources, processed on the appropriate systems (a DBMS, Java EE servers, mobile devices and so on), with the mainframe on the right as a potential producer and consumer of these messages. As daunting as all this may seem, it’s made quite simple, thanks to the level of abstraction the events supply, combined with packages such as CA Workload Automation ESP software.  

 

Automating processing in this way makes it possible to plug the TPS power of a mainframe into existing systems without concern for the vast differences in technologies. Additionally, things can run in reverse – that is, SNMP or other events from the mainframe can be processed by other components of the architecture. This dynamic workload processing allows enterprise architects to craft their mainframe strategies to efficiently meet the high Service Level Agreement demands that only mainframes can provide, all from the modern platforms and languages that developers are comfortable with.

 

Integrating existing mainframe software and capabilities with modern software environments through the dynamic workload processing, software from CA Technologies allows enterprise architects to guide developers in finding the “sweet spot” between the processing options.

 

For more on how enterprise architects and CIOs are getting the message about how to get even greater value from their mainframe environments, read this piece by Tam Harbert and her update here.. And let us know how you envision the mainframe’s place in your own enterprise architecture strategy.

0

I’m sure you’ve heard comments like these before: “How do I prove my value to the organization’s leaders? Why don’t they understand what enterprise architecture really enables for the business?”  Well, opportunity’s knocking to change all that.

 

You will recognize it by the Big Data overcoat it’s wearing.


You know that oft-quoted statistic that humans use no more than 10 percent of their brain power? It turns out that the enterprise effectively uses less than 5 percent of its data power. That means there’s a whole lot of data there that’s not being maximized to drive business revenue or cost-savings. The enterprise architect who can help align the infrastructure and processes so that the organization can do more and get more out of its data — delivering real, tangible results that senior leaders can “touch and feel,” so to speak — is the enterprise architect who will get the recognition he or she so richly deserves.


Clearly, you and your colleagues, businesses, agencies and the IT industry at large are thinking about this (have a look at the article Big Data Proliferation Requires Big Solutions here). In my last blog, for example, I talked about some of the skills prospective employers expect enterprise architects to bring to the job-market table, and increasingly one of them is expertise in dealing with Big Data. Consider also the attention being paid to the relationship between Big Data and enterprise architecture at big industry conferences. The Gartner Symposium ITxpo 2011 touted sessions for enterprise architects such as Big Data for IT/OT: Integrating Real-Time Data Into Decisions, for instance. And the Hadoop World 2011 conference also featured its own enterprise architecture track, whose topics include how the open source Apache Hadoop project is being used to build real-time big-data services at Facebook, and how companies can bridge the gap between data warehouses and Hadoop to extract business intelligence from large, heterogeneous data sets. 


Research firm Forrester — the minds behind that 5 percent estimated data use figure — also has been all over the role enterprise architects can play in helping the organization boost its data returns, including taking thought leadership roles on the importance of a holistically approached information architecture and the need to assess applications’ integration of knowledge through service-oriented architecture (SOA), business intelligence (BI) and other mechanisms. But the usual approaches and implementations of these capabilities may well require revisiting. In his blog, Forrester Principal Analyst Brian Hopkins has noted that Big Data “will require new processes and may totally redefine your approach to data governance.”


The why for making changes such as those Hopkins describes is tied to the fact that now we’re not just talking about making sense of a lot of data. That’s been happening around historical data and predictive analytics for a long time. The why lies in the multiple aspects of Big Data that Forrester and other analyst firms are talking about. Call it the four V’s of volume, velocity, variability and variety, as Forrester has. Or, apply its attributes in any acronym you prefer, such as SVA-US (scale, volume and acceleration — structured and unstructured, including rich media and social media data), maybe, or VCS (volume, complexity of data types, and speed). The end result is the same. Traditional data warehouse and business intelligence systems can’t affordably keep up with making sense of the deluge, in real time, across diverse formats and in unpredictable ways. Nor do those tried-and-true approaches necessarily lend themselves to the increased interaction with data by more business users.

 

Here are just a few of the projects I’ve heard about that help illustrate both the complexity of getting value from so much data that so relentlessly enters the enterprise in so many forms, and the concrete value of moving in this direction:


  • A major bank has a project under way to use everything from transaction data to audio files from service calls with customers to improve its ability to get a true picture of what happens in fraudulent cases and to better detect fraudulent occurrences. 


  • One large health insurance firm has to deal with data from internal and external sources sprawling across in-patient, out-patient, pharmacy, finance and cost-management groups, for analysis of everything from treatments to demographics to lab tests, in order to provide decision support that lets doctors and nurses choose the best course of care. 


  • Tracking social media — talk about a wild, wooly and unstructured Big Data space! — made it possible for one firm to identify influencers in its area and then to send marketing messages outlining its solution’s benefits to those whose messages it deemed might have an impact on their followers.

 

What’s needed to conquer such oncoming challenges and realize emerging successes is someone to champion a new way forward, to architect a vision around Big Data. That vision, I’d think, needs to be an expansive one, inclusive of things like direct interaction with data assets by the business and dynamic information discovery. That champion should be YOU.


How’s Big Data knocking at your enterprise’s door, and what’s your strategy for answering the call? Share your stories with your peers here.

1

A couple of months back I was taking a class on sketching at the Art Institute Museum. I was trying to learn how the UPS guy on the commercials can draw on a whiteboard and talk at the same time.  Needless to say this was not on the topic list.  Instead there was the topic of negative space.

 

What is negative space you might ask?

 

We will get back to that in a second...

 

Anyhow we got our stools to sit on, were handed charcoal and some paper, and sat at the top of the steps in the front lobby of the museum.  On the walls were these grillwork patterns that one will see on a building.  Complicated criss-crossing lines that made sense when viewed 20 feet away, but look too complex to even contemplate when viewed 1-2 feet away. The instructors asked us to draw them. There was the collective gasp as we realized that none of us, even the ones that had previous art training, had any chance of drawing them.

 

Then came this idea of negative space. The instructors asked us to draw the spaces between the grillwork. They wanted us to forget about the grillwork completely and draw what was behind it. Sounds strange, doesn't it? As I did this on the first grill I started drawing shapes.  When I looked at these shapes up close they all looked unrelated. As I drew more and more my sheet started to look like a bunch of weird shapes all strewn out on the paper.  This certainly appeared to be some strange exercise in futility. The instructors asked us to pull the paper a few feet away and "Voila," all of the shapes disappeared and what remained was the grillwork. It appeared the minute that I looked at the paper as a whole.

 

So what does this have to do with enterprise architecture?

 

Technology is a big part of enterprise architecture. Our tendency is to see everything within the confines of a technical implementation. "Which technologies make sense?" "Which ones do not?" "Is this a place for cloud computing?" "How does this fit in with SOA?"  If an we have a technology stack in place the questions are immediate. How does anything we want to do fit in with what is already there? 

 

Another way to ask these questions is to forget about the technology and infrastructure entirely. Start asking what would the situation be like if there was no technology at all. What would this mean to do this without technology? Do the design at the same level of abstraction as you would with the technology. Even forget that the users have computer screens, mobile phones and other devices.

 

This is negative space thinking. 

 

Ever wonder how files, trashcans, folders, and many or the other monikers ended up on personal computers?  These were not just pictures that were familiar to the user, they operate in the same way as their real-life counterparts.  We empty a trashcan,  we organize our files into filesystems, which were originally file cabinets.  How did this help in design?  It wasn't too hard to imagine putting all of the files that we have in file cabinets into the computer.  There was this instant connection. 

 

So how does this happen? How is this accomplished?

 

The iterative model gives us a great start.  Focus on these smaller stories instead of the big picture. As these stories are defined use common artifices, like the trashcans and folders used before, that are proxies to technology. Instead of databases think of lists, schedules, and papers. As these are brought together into the bigger story these pieces should start to converge. Looked at closely, these are just pieces of data, looked from afar and technology will start to emerge. 

 

What if you have the overall story already?

 

That is OK and a good thing.  This provides the scope and context for our stories. The trick is to avoid decomposing the larger stories into the smaller ones. One might see the overall grill and should. Instead of splitting the grill up into sections start finding and drawing the white spaces. Eventually, the internal grillwork will emerge. The same thing will happen in our case as well!

0

Recently I’ve been thinking about service-oriented architecture. SOA has been around long enough that it may sound like yesterday’s news. After a decade of formal SOA standards and deployments, organizations have become familiar with what it takes to deploy a SOA, along with its benefits.

 

 

Certainly, the financial services industry seems happy with the results. A recent Forrester survey found, for example, that of 80 IT executives from financial services firms around the world, close to three-quarters use SOA and business services in a significant number of business applications in a production environment, and many have plans to extend the SOA footprint in their financial services firm. Nearly 20 percent are planning or deploying SOA-based applications for quality assurance or pilot programs.

 

But familiarity shouldn't breed too much comfort. There’s always more to learn about any discipline, particularly one such as SOA that is closely entwined with enterprise architecture practices, given how critical such practices are to the business.

 

One effort that’s worth your getting more education about, for example, is the Open Group's Service-Oriented Architecture Ontology Technical Standard. Here, we’ll take look at how such an effort can make sense in your business, especially if you revise your SOA more than once per year -- making changes or updating the text, for instance.

 

The SOA Ontology will help you create an enterprisewide set of architecture documents if you don’t have one already, and further refine it if you already do.

 

SOA Ontology Is a Step to Clarity

 

As part of the Open Group’s vision of Boundaryless Information Flow, which aims to align IT with the business it serves, the SOA Ontology goals are to:

 

·         Enable clear communication between business and technical stakeholders

·         Define metadata for architectural artifacts

·         Create a model-driven SOA implementation

 

In a sense, the ontology is a model of models for developers of SOA-based software systems, expressed in the Web Ontology Language (OWL). It uses natural language to describe concepts and relationships, along with graphic illustrations. Specifically, it uses both XML — with a well-defined schema — and the Unified Modeling Language (UML) to model the system. UML is itself a useful ontology that is used to define whole architectures, models, and even other ontologies.

 

The Open Group’s SOA Ontology allows you to simultaneously define the interactions between all of the systems and services in your organization (the “big picture”), as well as the design of the individual systems and services. Because they’re often only part of overall enterprise architecture, the ability to clearly communicate the details of your SOA-based systems, their constituent components, their interactions with one another, and their usage within your overall architecture can directly contribute to the success or failure of your enterprise architecture and its implementation. The ontology allows you to clearly delineate the boundaries between SOA and the rest of your organization’s architecture.

 

 

The result of having all of the elements, relationships, sequences, policies and so on defined in OWL is a series of artifacts that can be used both visually, to “see” and discuss the SOA, as well as programmatically, to model and implement the SOA design. It’s not a stretch to think that once you accurately describe and visualize your architectural models with the SOA Ontology, you’ll be able to identify weaknesses to improve, missing pieces to fill in, and strengths to use in future projects.

 

 

Inside the SOA Ontology

 

As enterprise architects, you’ll want the technical details about the ontology, so here is a summary of the concepts defined by The Open Group:

 

The Ontology defines concepts such as system and element (or component), and relationships such as uses and represents (or “is a”), to associate them. Elements in the SOA domain include actors, tasks, services, or other concrete items such as a service bus for communication between services. Relationships describe how the system’s elements interact with one other. A task or service in the ontology associates the actors and elements within the system to describe how the system is used or interfaced with in the overall architecture.

 

Properties, such as does or doneBy clearly demarcate the responsibilities of the actors in the system. Diving deeper into the ontology, you define contracts, interfaces and information types to clearly state the capabilities of your system’s elements. For workflow-related systems, sequences of tasks can be defined as either a composition (where elements are built from other elements), or orchestration of elements (where elements interact more loosely). In another form of association and interaction, events define and allow for asynchronous communication within the system as well. For security, a policy is used to define rules that govern all of these interactions between elements.

 

Each element in the system may be a system in itself, which can be used in its more abstract form to describe composite services, or each element can be further broken down and explored using the same ontology.

 

This creates a system of systems where different stakeholders (business analysts, architects and developers) can dive as deep into the model as required. For example, business analysts can peruse the higher-level system definitions to ensure the entire problem domain has been addressed. Architects can take a more detailed look to determine that business needs have been met in terms of features and Service Level Agreements. Further, developers can dive deeper, examining each service’s constituent components as a road map to implementation. Finally, quality assurance can use it to ensure complete test coverage, end to end.

 

Visual modeling tools such as Embarcadero's Studio Architect, Troux Architect from Troux Technologies and Visual Modeling Platform from Sparx Systems all help drive architecture from idea to reality. The resulting artifacts take shape as UML diagrams, entity relationship models (ERM), and other object models. Some tools, such as IBM's Rational Rose, can even generate code for multiple programming languages.

 

 

If you want to learn more, take a look at the following resources:

·         The Open Group SOA definition

 

 

·         The Open Group’s Service-Oriented Architecture Ontology

 

 

·         Web Ontology Language (OWL):

 

 

 

 

0

How are enterprise architects going to enable the business agility that is so critical to enterprises today, as they seek to stare down growing global competition, and harness opportunities to prevail in new markets? The way forward is to tighten up adherence to five critical principles that always have guided — or at least, should have guided — enterprise architecture (EA) efforts. Slackening the reins may seem to be the way to get moving faster, but trust me — that’s only a temporary speed burst. It won’t set you up for the long haul.


So, let’s look with a fresh eye at some of the key steps to help you soundly respond to growing pressures.


Improve the Business Case

Often the best, and quickest, way to meet business needs is to more clearly define those needs in the first place. Spending a little more time up front to better define and communicate the business requirements behind the architecture will result in a more concise solution, and even greater time savings at each step along the way.


Here, the principles to follow are not unlike those your CIO must adopt to build a business case for any tech investment. A good primer to read is featured here in Smart Enterprise Exchange. Joe Peppard, Professor of Information Systems at the Cranfield University School of Management, explains the importance of improving the process used to build a business case — and doing so makes as much sense for the enterprise architect as it does for the CIO. After all, if the business case is weak or lacking, the architecture may be incomplete.


An effective process is one that involves a number of factors. For example, a complete cost/benefit analysis outlines all of the benefits to each business goal or need, remembering that these often can be more than monetary returns.


Another “must” is thoroughly examining the costs and risks associated with each business goal. Also, remember to involve parties ranging from business analysts to key development managers, as their feedback can result in a more refined business-needs analysis. At the same time, make sure to leave room for contrarian views that can be a spur to innovation and better ROI.


Improve Communication

IT architecture has little value if it cannot be thoroughly and clearly communicated to business and IT partners.


So you’ll need to:

  • Document the architecture clearly using standard methodologies and guidelines for the areas you’re architecting. Use Unified Modeling Language (UML), the Open Group’s service-oriented architecture (SOA) ontology, or other methods such as Martin Fowler’s patterns for enterprise architecture (EA) (see Patterns of Enterprise Application Architecture, Addison-Wesley, 2002). It’s fine to combine methodologies, but you should strive for consistency.
  • Allow for two-way communication. Avoid dictating to others what needs to be done, and how. Instead, create a culture and process that’s open to all opinions.
  • Create working groups for key areas, involving all stakeholders in these groups, led by experts.
  • Iterate the architecture through open discussion with the business on one side, and development on the other.  


Following these guidelines will result in a living, evolving architecture strategy that moves quickly to meet the ever-changing business and technology landscapes.


Ensure End-to-End Accountability

An enterprise architect and his/her vision can quickly become irrelevant if he or she is not involved in the end product. Accountability is key for success at all levels and has the following benefits:

  • It ensures that the architectural vision is carried through from definition to implementation.
  • It ensures buy-in along the participant chain, through to development and quality assurance.
  • It creates architecture advocates throughout the organization, increasing the number of people who believe in and communicate the overall vision.
  • It helps the enterprise architect and CTO put their foot down on silos and “out-of-band” development (otherwise known as skunk works).


Being involved in the development and deployment of the software the architecture defines is the way to ensure that the solution evolves rapidly, and remains relevant to the business. 


Improve Process Measurement

The architecture process should be constantly improved via a feedback loop. Past business technology investments should directly indicate the effectiveness of your architecture vision. To ensure this from the beginning, create key quality parameters to measure and analyze the effectiveness of your architecture each step of the way The Open Group's Architecture Review Checklist, for instance, can be a starting point. It covers questions about general architecture issues, as well as specific items, such as application server technology.


Gauge success of your architecture’s implementation by reviewing :

  • Reliability and availability: Did the resulting system have failover and redundancy designed-in?
  • Security: Were there any security issues in production that can be traced back to the architecture?
  • Modifiability/extensibility/portability: Over time, were development teams able to easily and cheaply extend the system without overhauling or abandoning the original architecture principles?
  • Interoperability: Did you design for the integration with future technologies, systems, and data?


 

If there were deficiencies in your enterprise applications that can be traced back to flaws or holes in the architecture, defining processes to ensure that future architecture work doesn't repeat the same mistakes will help to optimize those areas in the future.


Improve Your Digital Literacy

No one can be expected to know or remember the details of every discipline in a growing world of technology. You should, however, be able to locate, organize and communicate relevant pieces of information quickly and concisely using technology itself as a medium. This involves using hardware (i.e., desktop and mobile devices), as well as software to gather and index the appropriate information. 


Do this correctly, and you can expect to: 

  • Stay in front of emerging technology, not just the hot topics of the day.
  • Understand what has and hasn’t worked for other companies.
  • Remain a thought leader within the organization. 
  • Have up-to-date knowledge of costs related to hardware and software deployment as part of an architecture (i.e., basic hardware costs, consulting rates, hosting fees, average ROI for investment in particular areas such as integration, SOA, cloud and so on.)   


I’m going to say it: When it comes to enterprise architecture, be the turtle, not the hare. Take the time to do things right from the start, and the race is yours to win.


I’d love to hear your thoughts about whether such principles have guided and continue to guide your own efforts. Please feel free to share your comments, ideas and experiences with me and your fellow enterprise architects here. See you next week!


Eric Bruno is founder and Principal, Allure Technology Inc., which provides enterprises with online business solutions that leverage Internet technologies and approaches that combine simplicity, rich user interfaces, and service-oriented architectures. Eric also is an expert in full lifecycle, large-scale software architecture, design and development for client/server, highly distributed, multitiered Web, real-time and transactional software development environments. He has worked on large-scale systems, and served as technical advisor, chief architect and development team lead on numerous projects in industries including financial services.



We encourage your feedback. Reach out via the "Contact the Editor" and "Contact the Concierge" services for any needs, questions or comments. We look forward to serving you!

Paula Klein, Smart Enterprise Exchange Editor
e-mail

Ellen Lalier, Smart Enterprise Exchange Concierge
e-mail
phone 516-562-5727; fax 516-562-5466