With decades of software engineering and software development advances, we have learned techniques and methods to improve the software productivity and customer satisfaction. However, every day we push the bar to a new limit and software development organizations are faced with the challenge of catching up with the ever increasing expectations from customers.
The hardware costs are steadily declining and the software is growing in complexity day-by-day. Yet, customers are baffled by the fact that the software is slow even on faster machines. With the increasing restrictions on costs, resources, and time, software vendors identify the improvement areas. Thereby, software vendors want to increase the productivity by filling the gaps and adopting efficient processes, methods, and tools. Therefore, the next important question is "What are the crucial software development challenges"?
Today, several software development projects are faced with similar challenges, primarily focused on the distributed teams and collaboration. Major categories of the challenges include but are not limited to the following:
Teams are globally spread out
Cultural differences make it difficult to communicate effectively
Difficulty in coordination with Global Teams
Fast paced technology paradigms
Customized development practices in teams
In the following sections, we will see the distributed teams, collaboration, and team management aspects of software development in detail.
Increasing globalization has brought a few changes in the software development industry. One of them is "off shoring" either part of the system or whole modules. Off shoring is chosen for obvious reasons such as business cost effectiveness, availability of talent pool, and other strategic reasons. Off shoring has led to global software development teams with members from at least two geographical regions collaborating on the same project.
Software Professionals must adapt to the new reality of offshore outsourcing. | ||
| --Bertrand Meyer, ETH Zurich | ||
A team based on the same culture often has many common things to share and communicate informally compared to the teams spanning multiple cultures. Time zone difference, geographical distance, language, and cultural barriers create more information and psychological gaps in the project.
The co-located teams have the advantage that they have a line of sight, which helps them have informal discussions and thereby understand each other well. In the case of the geographically distributed teams, there is a possibility of misunderstanding created by communication. The tone of the language, and the choice of the words used in written or verbal communication, largely depend on the culture that one belongs to.
In practice, team members get information necessary to perform their tasks largely from peers, as opposed to formal, documented sources. To be able to tap this social resource, team members need to build social capital, meaning that they need to establish trust relationships with their peers.
This process of building trust does not occur so readily in a globally distributed team, sometimes leading to problems in the collaboration process. Informal collaboration tools, coupled with appropriate management practices, are an important part of the solution.
The act of working jointly in a co-operative manner to achieve a piece of a task is collaboration and it can happen in a formal or informal way. In the formal way of collaboration, typically the project manager or team leader assigns a "contact person" for any kind of questions or issues to answer. In the informal way of collaboration, team members work together at lunch or over a cup of coffee.
No matter what the problem is, it's always a people problem. | ||
| --Gerald M. Weinberg | ||
The proliferation of several technological advancements such as Web 2.0, Service Oriented Architecture, Mashups, Software as a Service, Cloud Computing, and many others made teams depend on each other for expertise and carry out the knowledge management in a collaborative manner.
Due to the nature of the cultures and backgrounds, formal or/and the informal way of communication is preferred one over the other. Convergence of the collaboration tools into the software development tool was needed to solve the collaboration problems. Collaboration tools offer much more than the basic communication channels provided by e-mail and telephones. These tools can make team members aware of each other. After team members are aware of each other, they are then able to communicate and work together to achieve common goals.
Collaboration is supported through tools that allow communication, knowledge sharing, and analysis. Tools such as blogs, Wikis, bulletin boards, and instant messaging clients are a few collaborative tools used now. An interesting side effect of informal knowledge sharing tools, such as blogs and Wikis, is that they increase awareness. When people read blogs, they can learn more about the authors and their interests. In this way, even if two people are in a totally different geographical area, they may know a lot of each other from the social collaboration and communication tools.
With the global teams in place, pressure to achieve higher team productivity makes team management even more challenging.
When a member joins the team, he should be introduced to the project technology, development environments, given proper access rights to the tools, and so on. The team member is forced to learn several tools, processes, and techniques in a fast paced environment unless he comes from a similar environment.
Once the project is broken in to smaller chunks, they should be scheduled to meet the release schedule. The team manager should be sensitive about the geographically distributed teams with different vacation times, holiday times, or anything that affects schedule. In such situation, the communication between the team manager and team member becomes the bottleneck for the success of the project.
The team manager should have efficient tools for task assignment and task scheduling. The challenge is multidimensional where a single module's team is spread across the geography. In such case, the team within should co-ordinate to achieve their tasks and must find an efficient way to communicate.
Task assignment and scheduling includes the following:
Defining the requirements, designing smaller chunks of tasks, and scheduling the tasks does not yield the project success without tracking the project. Project tracking should make it visible about who is doing what, tasks in progress, whether there's any slack, whether there are any problems, whether anyone needs help, and team-member efficiency. A burn-down chart will also help to get an idea of the work left to do versus time. In Agile development, a burn-down chart is a graphical representation of work left to do versus time.
Once requirements are coded for the functionality, they must be integrated to verify and validate. Any issues in the build should be immediately notified to the team and corrective action should be taken. In the modern software development, it is not uncommon to track the software stability with nightly builds.
Many projects follow the practice of writing unit tests and sometimes automated tests are embedded during the build process. Considering that developers covered all the functionality with the unit test cases, a build gives a considerable confidence about the product. Then, the Quality Assurance (QA) team can do the functional testing.
Depending on the project and team, one may have different release time frames. Some projects have relatively shorter release cycles (for example, 2-4 weeks) and some have longer release cycles (every six months or even longer than one year). In either case, it is important to communicate the importance of the releases and schedule to the entire team.
In the global or distributed team setting, it is very easy to misunderstand and misrepresent the communication. Project updates not happening on an open platform leads to team members feeling insecure and mistrusted. Or even worse when you come to know about something after the fact.
Choosing the tools in a way to make the requirements, task estimates, task schedule, work progress, project tracking, project health, build results, release schedule, and project announcements transparent is crucial to gain the trust and confidence of the team. Each one contributes to the complexity of the software being developed.
The following table summarizes the challenges in the software development with respect to each stakeholder:
Depending on the organization, geographical location, and technology area, the challenges could be multidimensional. Two projects may not have the same situations and constraints. However, they may have very similar challenges of collaboration and distributed teams in project management. All the mentioned problems in the table can be summarized as follows:
A team member inception must be easy
Team members do not want to deal with the process overheads
Team members need process transparency
Version control systems must know and understand issues
Task switching must be easy
Management needs a crisp overview of project available 24/7
Tracking of requirements and tasks must be easy
Replanning must be lightweight and easy
Team communication must be easy—without overheads
Development, QA, and management teams must have access to project status
QA must have access to release schedules and any impediments
Stakeholders must have a controlled access to the project status reports